00010000:00010000:1.0F:1789265537.537843:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1789265538.561744:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0F:1789265538.582199:0:17172:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:0.0:1789265538.582240:0:17172:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fcb838d8480 refcount 2 committed 0 result 0 batchid 4294967529 00010000:00010000:3.0:1789265538.582242:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a97f24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789265538.582246:0:17172:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fcb82f75500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fcb838d8d80 00000020:00080000:0.0:1789265538.582250:0:17172:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fcb82f75300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fcb82ae6c00 00010000:00010000:3.0:1789265538.582258:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a97f24 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.582270:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a97f24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.582277:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265538.582283:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a97f24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.582291:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a97f24 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.582315:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fcc8b0c6600) 00010000:00010000:3.0:1789265538.582318:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265538.582324:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a97f24 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265538.582331:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4e00/0x9272d942b4a97f24 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789265538.582333:0:17232:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:1.0:1789265538.582436:0:17232:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1789265539.082321:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417593728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265539.082412:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265539.082485:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265539.082492:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417593600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265539.082517:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265539.082555:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417593728 00000100:00100000:3.0:1789265539.082563:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417593728 00000100:00100000:3.0:1789265539.082634:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789265539.082643:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417593728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265539.082684:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789265539.082730:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417593728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265539.082737:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789265539.082758:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417593600 00000100:00100000:3.0:1789265539.082762:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417593600 00000100:00100000:3.0:1789265539.082792:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265539.082797:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417593600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265539.082815:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789265539.082853:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417593600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265539.082859:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1789265539.082874:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265539.082917:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417593600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265539.082930:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417593728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265539.085234:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417593856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265539.085324:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265539.085409:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417593856 00000100:00100000:3.0:1789265539.085418:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417593856 00000100:00100000:3.0:1789265539.085472:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789265539.085482:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417593856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265539.085523:0:17934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265539.085575:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417593856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265539.085603:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789265539.085655:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417593856:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1789265539.087233:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789265539.587130:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417593984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265539.587201:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265539.587260:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417593984 00000100:00100000:3.0:1789265539.587268:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417593984 00000100:00100000:3.0:1789265539.587320:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789265539.587331:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417593984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265539.587359:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789265539.587402:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417593984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265539.587480:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1789265539.587503:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265539.587542:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417593984:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789265539.590241:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265539.590372:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417594112:0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.590513:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265539.590556:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417594624:0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.590594:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265539.590613:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417595136:0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.590635:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265539.590660:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789265539.590666:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417594240:0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.590689:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265539.590704:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417594752:0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.590723:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265539.590753:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417594368:0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.590776:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265539.590793:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417594880:0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.590816:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265539.590835:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789265539.590842:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417594496:0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.590862:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265539.590873:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417595008:0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.590890:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265539.590915:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417594112 00000100:00100000:1.0:1789265539.590922:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417594112 00000100:00100000:1.0:1789265539.590976:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789265539.590984:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+24:3641:x1876180417594112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.591557:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a57aa04c-0472-45c4-bafc-6983957e249b+24:3641:x1876180417594112:12345-0@lo:400:kworker.0 Request processed in 572us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265539.591566:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789265539.591612:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417594624 00000100:00100000:1.0:1789265539.591616:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417594624 00000100:00100000:1.0:1789265539.591637:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417595136 00000100:00100000:1.0:1789265539.591640:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417595136 00000100:00100000:1.0:1789265539.591661:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417594752 00000100:00100000:1.0:1789265539.591664:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417594752 00000100:00100000:1.0:1789265539.591674:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417594880 00000100:00100000:1.0:1789265539.591676:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417594880 00000100:00100000:1.0:1789265539.591688:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417594496 00000100:00100000:1.0:1789265539.591690:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417594496 00000100:00100000:1.0:1789265539.591700:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417595008 00000100:00100000:1.0:1789265539.591702:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417595008 00000100:00100000:1.0:1789265539.591714:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265539.591720:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417594624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.591753:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417594624:12345-0@lo:400:kworker.0 Request processed in 33us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265539.591760:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265539.591771:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789265539.591777:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417595136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.591805:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417595136:12345-0@lo:400:kworker.0 Request processed in 28us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265539.591811:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789265539.591823:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789265539.591829:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417594752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.591865:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417594752:12345-0@lo:400:kworker.0 Request processed in 36us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265539.591871:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789265539.591885:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789265539.591890:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417594880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.591921:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417594880:12345-0@lo:400:kworker.0 Request processed in 31us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265539.591927:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789265539.591938:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789265539.591944:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417594496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.591972:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417594496:12345-0@lo:400:kworker.0 Request processed in 28us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265539.591978:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789265539.591990:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789265539.591996:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417595008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265539.593174:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417594240 00000100:00100000:0.0:1789265539.593183:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417594240 00000100:00100000:0.0:1789265539.593225:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417594368 00000100:00100000:0.0:1789265539.593228:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417594368 00000100:00100000:0.0:1789265539.593253:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265539.593260:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417594240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265539.593313:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417594240:12345-0@lo:400:kworker.0 Request processed in 54us (2622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265539.593320:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265539.593334:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789265539.593340:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417594368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265539.593369:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417594368:12345-0@lo:400:kworker.0 Request processed in 30us (2592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265539.593375:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789265539.593598:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417595008:12345-0@lo:400:kworker.0 Request processed in 1602us (2705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265539.593607:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789265539.593653:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417594240:0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.593668:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417594752:0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.593679:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417594112:0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.593691:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417594624:0@lo:400:kworker.0 00010000:00080000:1.0:1789265539.593703:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc91421880 x1876180417595136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265539.593724:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417595136:0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.593753:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265539.593762:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417595264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265539.593798:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789265539.593843:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265539.593847:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265539.593850:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265539.593852:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265539.593863:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417595392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265539.593886:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265539.593911:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417594496:0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.593921:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417595008:0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.593929:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417594368:0@lo:400:kworker.0 00010000:00080000:1.0:1789265539.593939:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc91423480 x1876180417594880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265539.593947:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417594880:0@lo:400:kworker.0 00000100:00100000:1.0:1789265539.593978:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417595264 00000100:00100000:1.0:1789265539.593981:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417595264 00000100:00100000:0.0:1789265539.594756:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417595392 00000100:00100000:0.0:1789265539.594764:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417595392 00000100:00100000:0.0:1789265539.594793:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265539.594800:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417595264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265539.594819:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789265539.594872:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417595264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265539.594878:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265539.594903:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265539.594909:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417595392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265539.594919:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1789265539.594952:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417595392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265539.594958:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789265539.596517:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417595264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265539.596593:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417595392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265539.983694:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265539.985239:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399698048 00000100:00100000:0.0:1789265539.985251:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399698048 00000100:00100000:0.0:1789265539.985311:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 65 00000100:00100000:0.0:1789265539.985322:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+13:15584:x1876180399698048:12345-192.168.203.49@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789265539.985417:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+13:15584:x1876180399698048:12345-192.168.203.49@tcp:60:lhsmtool_posix.0 Request processed in 97us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265539.985425:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 65 00000100:00080000:1.0:1789265539.988831:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265539.993617:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265539.993656:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399698176 00000100:00100000:3.0:1789265539.993664:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399698176 00000100:00100000:3.0:1789265539.993727:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 66 00000100:00100000:3.0:1789265539.993737:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+5:15584:x1876180399698176:12345-192.168.203.49@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789265539.993834:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:befb0935-501c-4d01-87d3-564eb87bef45+5:15584:x1876180399698176:12345-192.168.203.49@tcp:60:lhsmtool_posix.0 Request processed in 97us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265539.993842:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 66 00000100:00080000:3.0:1789265539.993866:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265540.003157:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265540.003191:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399698432 00000100:00100000:3.0:1789265540.003207:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399698432 00000100:00100000:3.0:1789265540.003258:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:3.0:1789265540.003269:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:befb0935-501c-4d01-87d3-564eb87bef45+13:15584:x1876180399698432:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789265540.006778:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:befb0935-501c-4d01-87d3-564eb87bef45+14:15584:x1876180399698432:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 Request processed in 3502us (3621us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1789265540.006791:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 12 00010000:00010000:1.0:1789265540.611082:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265540.938453:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265540.938496:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265540.938562:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399698560 00000100:00100000:3.0:1789265540.938579:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265540.938590:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399698560 00000100:00100000:1.0:1789265540.938619:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399698816 00000100:00100000:0.0:1789265540.938696:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 169 00000100:00100000:0.0:1789265540.938709:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+13:2394:x1876180399698560:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0F:1789265540.938732:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399698688 00000100:00100000:2.0:1789265540.938752:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399698688 00000100:00100000:2.0:1789265540.938792:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 78 00000100:00100000:2.0:1789265540.938801:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+14:2394:x1876180399698688:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265540.938806:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0529895c-e416-4b40-9cbc-d7eabe178719+13:2394:x1876180399698560:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 98us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265540.938816:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 169 00000100:00100000:2.0:1789265540.938861:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+14:2394:x1876180399698688:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 61us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265540.938869:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 78 00000100:00100000:1.0:1789265540.938985:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399698816 00000100:00100000:1.0:1789265540.939058:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 79 00000100:00100000:1.0:1789265540.939067:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+5:2394:x1876180399698816:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265540.939101:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+5:2394:x1876180399698816:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 35us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265540.939109:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 79 00000100:00100000:3.0:1789265540.947086:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265540.947392:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265540.951397:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265540.951765:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399698944 00000100:00100000:2.0:1789265540.951785:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399698944 00000100:00100000:2.0:1789265540.952037:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399699072 00000100:00100000:2.0:1789265540.952042:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399699072 00000100:00100000:0.0:1789265540.952474:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 26 00000100:00100000:0.0:1789265540.952506:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:befb0935-501c-4d01-87d3-564eb87bef45+5:2392:x1876180399698944:12345-192.168.203.49@tcp:9:kworker.0 00000020:00000080:0.0:1789265540.952555:0:18700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97c53 00000100:00080000:0.0:1789265540.952593:0:18700:0:(import.c:65:import_set_state_nolock()) ffff9fcb82c57800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789265540.952666:0:18700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789265540.953720:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265540.953748:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265540.954330:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:befb0935-501c-4d01-87d3-564eb87bef45+2:2392:x1876180399698944:12345-192.168.203.49@tcp:9:kworker.0 Request processed in 1833us (7254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265540.954347:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 26 00000100:00100000:0.0:1789265540.954382:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399699456 00000100:00100000:0.0:1789265540.954391:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399699456 00000100:00100000:3.0:1789265540.954591:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00080000:1.0:1789265540.956384:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265540.956396:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789265540.956441:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265540.956463:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399699584 00000100:00100000:1.0:1789265540.956473:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399699584 00000100:00100000:1.0:1789265540.956559:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 27 00000100:00100000:1.0:1789265540.956581:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2392:x1876180399699584:12345-192.168.203.49@tcp:9:kworker.0 00000020:00000080:1.0:1789265540.956613:0:18701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97c99 00000100:00080000:1.0:1789265540.956631:0:18701:0:(import.c:65:import_set_state_nolock()) ffff9fccb6eca800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789265540.956635:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 28 00000100:00100000:0.0:1789265540.956646:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2392:x1876180399699456:12345-192.168.203.49@tcp:9:kworker.0 00000020:00000080:0.0:1789265540.956666:0:18700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97c92 00000100:00080000:0.0:1789265540.956673:0:18700:0:(import.c:65:import_set_state_nolock()) ffff9fccafac0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789265540.956682:0:18701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000001:00000004:0.0:1789265540.956712:0:18700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789265540.956865:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+2:2392:x1876180399699584:12345-192.168.203.49@tcp:9:kworker.0 Request processed in 296us (2273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265540.956874:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 27 00010000:00010000:1.0:1789265540.956894:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265540.956900:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265540.956932:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789265540.956935:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265540.956972:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399699200 00000100:00100000:1.0:1789265540.956977:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399699200 00000100:00100000:1.0:1789265540.957009:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399699328 00000100:00100000:1.0:1789265540.957012:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399699328 00000100:00100000:1.0:1789265540.957076:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 80 00000100:00100000:1.0:1789265540.957100:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:2394:x1876180399699200:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265540.957326:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 81 00000100:00100000:2.0:1789265540.957336:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2393:x1876180399699328:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1789265540.957970:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+2:2392:x1876180399699456:12345-192.168.203.49@tcp:9:kworker.0 Request processed in 1322us (4216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265540.957980:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 28 00000100:00080000:0.0:1789265540.958110:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265540.958115:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265540.958421:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:2394:x1876180399699200:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 1320us (7038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265540.958431:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 80 00000100:00100000:2.0:1789265540.958525:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2393:x1876180399699328:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 1189us (4809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265540.958602:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 81 00000100:00100000:2.0:1789265540.958702:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 22 00000100:00100000:2.0:1789265540.958712:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb838f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399699072:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265540.958747:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb838f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399699072:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 37us (11355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265540.958753:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 22 00010000:00010000:1.0:1789265541.635149:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265542.658238:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265543.347499:0:20570:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 22:12:22 (1789265542) 00010000:00010000:1.0:1789265543.682404:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265544.200157:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417595520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265544.200251:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265544.200395:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417595520 00000100:00100000:0.0:1789265544.200404:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417595520 00000100:00100000:0.0:1789265544.200460:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789265544.200470:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417595520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265544.200512:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789265544.200576:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417595520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265544.200585:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789265544.200639:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417595520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265544.202214:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417595648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265544.202288:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265544.202376:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417595648 00000100:00100000:1.0:1789265544.202384:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417595648 00000100:00100000:1.0:1789265544.202441:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789265544.202450:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417595648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265544.202484:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789265544.202528:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417595648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265544.202536:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789265544.202568:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265544.202610:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417595648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265544.202659:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417595776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265544.202688:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265544.202727:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417595776 00000100:00100000:1.0:1789265544.202731:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417595776 00000100:00100000:1.0:1789265544.202757:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789265544.202764:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417595776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265544.202790:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789265544.204167:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417595776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1395us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265544.204179:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789265544.204396:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417595776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265544.705560:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265544.705602:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417595904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265544.705696:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265544.705889:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417595904 00000100:00100000:2.0:1789265544.705905:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417595904 00000100:00100000:2.0:1789265544.705980:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265544.705993:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417595904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265544.706074:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789265544.706136:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417595904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 146us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265544.706144:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1789265544.706170:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265544.706262:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417595904:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789265544.706725:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265544.706852:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417596032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265544.706900:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265544.707142:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417596288:0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.707180:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265544.707205:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcca955f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417596800:0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.707231:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265544.707254:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789265544.707260:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417596160:0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.707289:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265544.707332:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcca955c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417596672:0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.707355:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265544.707404:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417596288 00000100:00100000:3.0:1789265544.707411:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417596288 00000100:00100000:3.0:1789265544.707469:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265544.707478:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417596288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.707527:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417596288:12345-0@lo:400:kworker.0 Request processed in 50us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265544.707535:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265544.707574:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417596800 00000100:00100000:3.0:1789265544.707578:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417596800 00000100:00100000:3.0:1789265544.707609:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417596672 00000100:00100000:3.0:1789265544.707613:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417596672 00000100:00100000:3.0:1789265544.707635:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789265544.707640:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417596800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.707664:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417596800:12345-0@lo:400:kworker.0 Request processed in 25us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265544.707669:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789265544.707676:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789265544.707679:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417596672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.707693:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417596672:12345-0@lo:400:kworker.0 Request processed in 14us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265544.707697:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789265544.707710:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417596160 00000100:00100000:3.0:1789265544.707713:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417596160 00000100:00100000:3.0:1789265544.707732:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789265544.707736:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+24:3642:x1876180417596160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.707754:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a57aa04c-0472-45c4-bafc-6983957e249b+24:3642:x1876180417596160:12345-0@lo:400:kworker.0 Request processed in 18us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265544.707766:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:3.0:1789265544.707803:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265544.707807:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265544.707810:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265544.707820:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417596416:0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.707847:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265544.707865:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcca955e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417596928:0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.707886:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265544.707902:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789265544.707908:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcca955f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417596544:0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.707930:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265544.707945:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcca955fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417597056:0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.707965:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265544.707983:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417596416 00000100:00100000:3.0:1789265544.707986:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417596416 00000100:00100000:3.0:1789265544.708003:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417596928 00000100:00100000:3.0:1789265544.708006:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417596928 00000100:00100000:3.0:1789265544.708053:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417596544 00000100:00100000:3.0:1789265544.708061:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417596544 00000100:00100000:3.0:1789265544.708074:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417597056 00000100:00100000:3.0:1789265544.708077:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417597056 00000100:00100000:3.0:1789265544.708090:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789265544.708096:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417596416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.708134:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417596416:12345-0@lo:400:kworker.0 Request processed in 37us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265544.708141:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789265544.708152:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789265544.708166:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417596928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.708194:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417596928:12345-0@lo:400:kworker.0 Request processed in 30us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265544.708200:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789265544.708211:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789265544.708216:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417596544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.708237:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417596544:12345-0@lo:400:kworker.0 Request processed in 21us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265544.708241:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789265544.708251:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789265544.708256:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417597056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.708282:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417597056:12345-0@lo:400:kworker.0 Request processed in 27us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265544.708287:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1789265544.708302:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265544.708305:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265544.708333:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcca955f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417596544:0@lo:400:kworker.0 00010000:00080000:3.0:1789265544.708347:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcca955fb80 x1876180417597056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265544.708357:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcca955fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417597056:0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.708366:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417596416:0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.708374:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcca955e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417596928:0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.708406:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417596160:0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.708429:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcca955c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417596672:0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.708439:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417596288:0@lo:400:kworker.0 00010000:00080000:3.0:1789265544.708448:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcca955f800 x1876180417596800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265544.708457:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcca955f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417596800:0@lo:400:kworker.0 00000100:00100000:3.0:1789265544.708473:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265544.708478:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417597184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265544.708504:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265544.708535:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417596032 00000100:00100000:3.0:1789265544.708539:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417596032 00000100:00100000:3.0:1789265544.708576:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417597184 00000100:00100000:3.0:1789265544.708579:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417597184 00000100:00100000:3.0:1789265544.708591:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789265544.708597:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417596032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265544.708614:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789265544.708650:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417596032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265544.708656:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789265544.708667:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789265544.708672:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417597184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265544.708682:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789265544.708710:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417597184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265544.708715:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789265544.708735:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265544.708767:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417596032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265544.708793:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417597184:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1789265544.709894:0:17172:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1789265544.709913:0:17172:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:1.0:1789265544.709985:0:17232:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:1.0:1789265544.709999:0:17232:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:00080000:2.0:1789265545.478289:0:17228:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789265545.478304:0:17228:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265545.478342:0:17228:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789265545.478352:0:17228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789265545.729232:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265546.060090:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265546.060155:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265546.060192:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265546.060232:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265546.060255:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265546.060279:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265546.060315:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399699712 00000100:00100000:3.0:1789265546.060327:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399699712 00000100:00100000:3.0:1789265546.060391:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 171 00000100:00100000:3.0:1789265546.060403:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+13:2393:x1876180399699712:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265546.060492:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0529895c-e416-4b40-9cbc-d7eabe178719+13:2393:x1876180399699712:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 91us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265546.060501:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 171 00000100:00100000:3.0:1789265546.060552:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399699840 00000100:00100000:3.0:1789265546.060556:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399699840 00000100:00100000:3.0:1789265546.060594:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399700352 00000100:00100000:3.0:1789265546.060597:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399700352 00000100:00100000:3.0:1789265546.060614:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399699968 00000100:00100000:3.0:1789265546.060617:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399699968 00000100:00100000:3.0:1789265546.060632:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399700224 00000100:00100000:3.0:1789265546.060635:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399700224 00000100:00100000:3.0:1789265546.060651:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 88 00000100:00100000:3.0:1789265546.060658:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+13:2393:x1876180399699840:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265546.060693:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+13:2393:x1876180399699840:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 35us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265546.060719:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 88 00000100:00100000:3.0:1789265546.060733:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 89 00000100:00100000:3.0:1789265546.060740:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2393:x1876180399700352:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265546.060769:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2393:x1876180399700352:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 30us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265546.060775:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 89 00000100:00100000:3.0:1789265546.060788:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 90 00000100:00100000:3.0:1789265546.060794:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399699968:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265546.060819:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399699968:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 26us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265546.060826:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 90 00000100:00100000:3.0:1789265546.060837:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 91 00000100:00100000:3.0:1789265546.060843:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:2393:x1876180399700224:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265546.060868:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:2393:x1876180399700224:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 25us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265546.060874:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 91 00000100:00080000:3.0:1789265546.060896:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265546.060901:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265546.061216:0:19247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399700096 00000100:00100000:1.0:1789265546.061222:0:19247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399700096 00000100:00100000:1.0:1789265546.061279:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:1.0:1789265546.061287:0:19247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399700096:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265546.061321:0:19247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:befb0935-501c-4d01-87d3-564eb87bef45+5:2393:x1876180399700096:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 36us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265546.061328:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00080000:3.0:1789265546.061788:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789265546.755327:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789265546.760239:0:18696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 32f639db-fb18-46c7-87cd-9f5b45c18fc6 00000020:00000080:1.0:1789265546.760250:0:18696:0:(genops.c:885:class_export_put()) final put ffff9fccafac3000/32f639db-fb18-46c7-87cd-9f5b45c18fc6 00000001:00100000:1.0:1789265546.760310:0:18696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of befb0935-501c-4d01-87d3-564eb87bef45 00000020:00000080:1.0:1789265546.760313:0:18696:0:(genops.c:885:class_export_put()) final put ffff9fcb82c54800/befb0935-501c-4d01-87d3-564eb87bef45 00000001:00100000:0.0:1789265546.761711:0:19514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 32f639db-fb18-46c7-87cd-9f5b45c18fc6 00000020:00000080:0.0:1789265546.761718:0:19514:0:(genops.c:885:class_export_put()) final put ffff9fccb6ecf800/32f639db-fb18-46c7-87cd-9f5b45c18fc6 00000020:00000080:2.0:1789265546.764358:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccafac3000/32f639db-fb18-46c7-87cd-9f5b45c18fc6 for lustre-OST0000 00000020:00000080:2.0:1789265546.765368:0:17249:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccafac0800 for lustre-OST0000 00000020:00000080:2.0:1789265546.767049:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb82c54800/befb0935-501c-4d01-87d3-564eb87bef45 for lustre-OST0000 00000020:00000080:2.0:1789265546.767274:0:17249:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb82c57800 for lustre-OST0000 00000020:00000080:2.0:1789265546.769974:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccb6ecf800/32f639db-fb18-46c7-87cd-9f5b45c18fc6 for lustre-OST0001 00000020:00000080:2.0:1789265546.770048:0:17249:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccb6eca800 for lustre-OST0001 00000100:00100000:3.0:1789265547.760662:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265547.761067:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399700608 00000100:00100000:0.0:1789265547.761085:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399700608 00000100:00100000:0.0:1789265547.761146:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:0.0:1789265547.761157:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcca955c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:befb0935-501c-4d01-87d3-564eb87bef45+13:16347:x1876180399700608:12345-192.168.203.49@tcp:35:umount.0 00000001:00080000:0.0:1789265547.761386:0:17195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1789265547.761468:0:17195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:0.0:1789265547.761733:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcca955c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:befb0935-501c-4d01-87d3-564eb87bef45+16:16347:x1876180399700608:12345-192.168.203.49@tcp:35:umount.0 Request processed in 574us (1075us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1789265547.761741:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 13 00000020:00080000:0.0:1789265547.761745:0:17195:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789265547.774664:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265547.774705:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265547.774740:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265547.775237:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399700736 00000100:00100000:2.0:1789265547.775248:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399700736 00000100:00100000:2.0:1789265547.775317:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399700992 00000100:00100000:2.0:1789265547.775321:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399700992 00000100:00100000:2.0:1789265547.775334:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399700864 00000100:00100000:2.0:1789265547.775337:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399700864 00000100:00100000:2.0:1789265547.775355:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:2.0:1789265547.775364:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0529895c-e416-4b40-9cbc-d7eabe178719+15:2394:x1876180399700736:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265547.775507:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265547.775538:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2ff400/0x9272d942b4a97c30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc16a expref: 15 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265547.775574:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265547.775644:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0529895c-e416-4b40-9cbc-d7eabe178719+14:2394:x1876180399700736:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 280us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265547.775653:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:2.0:1789265547.775672:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:2.0:1789265547.775678:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0529895c-e416-4b40-9cbc-d7eabe178719+13:2394:x1876180399700992:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265547.775686:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265547.775696:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a97cf4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc251 expref: 13 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265547.775706:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265547.775722:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0529895c-e416-4b40-9cbc-d7eabe178719+12:2394:x1876180399700992:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 45us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265547.775729:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:2.0:1789265547.775741:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5 00000100:00100000:2.0:1789265547.775747:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0529895c-e416-4b40-9cbc-d7eabe178719+11:2394:x1876180399700864:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265547.775754:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265547.775763:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b7c00/0x9272d942b4a97c37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc19b expref: 11 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265547.775771:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265547.775797:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0529895c-e416-4b40-9cbc-d7eabe178719+10:2394:x1876180399700864:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 40us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265547.775804:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5 00000100:00100000:0.0:1789265547.776143:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265547.776357:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399701120 00000100:00100000:3.0:1789265547.776364:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399701120 00000100:00100000:3.0:1789265547.776409:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00100000:3.0:1789265547.776417:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:befb0935-501c-4d01-87d3-564eb87bef45+5:2392:x1876180399701120:12345-192.168.203.49@tcp:9:umount.0 00000020:00000080:3.0:1789265547.776497:0:19582:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97c5a 00000100:00080000:3.0:1789265547.776507:0:19582:0:(import.c:65:import_set_state_nolock()) ffff9fccafac1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789265547.776567:0:19582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00010000:00010000:0.0:1789265547.776712:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265547.778665:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:befb0935-501c-4d01-87d3-564eb87bef45+2:2392:x1876180399701120:12345-192.168.203.49@tcp:9:umount.0 Request processed in 2238us (2513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265547.778680:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 29 00010000:00010000:0.0:1789265547.785712:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265547.792363:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265547.792507:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399702016 00000100:00100000:3.0:1789265547.792517:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399702016 00000100:00100000:3.0:1789265547.792599:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 67 00000100:00100000:3.0:1789265547.792610:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+16:2392:x1876180399702016:12345-192.168.203.49@tcp:39:umount.0 00000020:00000080:3.0:1789265547.792642:0:17192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97c45 00000020:00010000:3.0:1789265547.792659:0:17192:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fcb821eb800: total 0 00000100:00080000:3.0:1789265547.792664:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9fcb821eb000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789265547.792685:0:17192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:3.0:1789265547.792864:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:befb0935-501c-4d01-87d3-564eb87bef45+15:2392:x1876180399702016:12345-192.168.203.49@tcp:39:umount.0 Request processed in 255us (510us total) trans 8589934627 rc 0/0 00000100:00100000:3.0:1789265547.792871:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 67 00000020:00010000:1.0:1789265547.793958:0:17180:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fcb821eb800: total 0 00010000:00010000:1.0:1789265547.793966:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265547.794063:0:17180:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fcb821eb800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789265547.794107:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:1.0:1789265547.794110:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265547.794119:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a97e9f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2d6 expref: 14 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265547.794153:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fcc8b0c6f00) 00010000:00010000:1.0:1789265547.794155:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265547.794160:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a97d2c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc25f expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265547.794177:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:1.0:1789265547.794179:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265547.794183:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a97e6e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2c1 expref: 12 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265547.794195:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd51400) 00010000:00010000:1.0:1789265547.794197:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265547.794202:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da4000/0x9272d942b4a97d6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc26d expref: 11 pid: 19245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265547.794213:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fcc8b0c6600) 00010000:00010000:1.0:1789265547.794215:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265547.794219:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52c00/0x9272d942b4a97efa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc2eb expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265547.794232:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fcc8b0c6200) 00010000:00010000:1.0:1789265547.794234:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265547.794237:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccbd2fea00/0x9272d942b4a97f4e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc307 expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265547.794250:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fcc8b0c6c00) 00010000:00010000:1.0:1789265547.794252:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789265547.794261:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a97d10 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc258 expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265547.794277:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fcb83b85000) 00010000:00010000:1.0:1789265547.794279:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789265547.794283:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83da5c00/0x9272d942b4a97df0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc297 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265547.794296:0:17180:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fcb821eb800, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1789265547.794434:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265547.794437:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265547.794439:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265547.803994:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265547.804245:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399702144 00000100:00100000:0.0:1789265547.804256:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399702144 00000100:00100000:0.0:1789265547.804325:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 68 00000100:00100000:0.0:1789265547.804335:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+5:2392:x1876180399702144:12345-192.168.203.49@tcp:39:umount.0 00000020:00000080:0.0:1789265547.804383:0:17194:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97c4c 00000100:00080000:0.0:1789265547.804400:0:17194:0:(import.c:65:import_set_state_nolock()) ffff9fcb82c56800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789265547.804432:0:17194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789265547.804693:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:befb0935-501c-4d01-87d3-564eb87bef45+3:2392:x1876180399702144:12345-192.168.203.49@tcp:39:umount.0 Request processed in 358us (706us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789265547.804701:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 68 00010000:00010000:1.0:1789265547.805328:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265548.801584:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789265549.314296:0:17945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789265549.314843:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417597440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265549.314915:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265549.315083:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417597440 00000100:00100000:2.0:1789265549.315103:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417597440 00000100:00100000:2.0:1789265549.315153:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789265549.315161:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417597440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265549.315193:0:17934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789265549.315239:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417597440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265549.315246:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789265549.315539:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265549.315553:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417597312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265549.315594:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265549.315630:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417597312 00000100:00100000:3.0:1789265549.315636:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417597312 00000100:00080000:1.0:1789265549.315671:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265549.315682:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789265549.315693:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417597312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789265549.315715:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789265549.315768:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417597312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265549.315776:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789265549.315781:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417597568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265549.315814:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265549.315968:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417597568 00000100:00100000:3.0:1789265549.315983:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417597568 00000100:00100000:3.0:1789265549.316016:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789265549.316041:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417597568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265549.316061:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265549.316111:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417597568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265549.316118:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789265549.316156:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417597568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265549.316272:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417597312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789265549.316962:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417597440:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789265549.825324:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265549.826134:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417597696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265549.826223:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265549.826494:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417597696 00000100:00100000:2.0:1789265549.826503:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417597696 00000100:00100000:2.0:1789265549.826578:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789265549.826588:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417597696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265549.826619:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789265549.826730:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417597696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 143us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265549.826738:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789265549.826781:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417597696:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789265549.826837:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265549.827072:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcca955ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417598080:0@lo:400:kworker.0 00000100:00100000:3.0:1789265549.827106:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265549.827122:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417598592:0@lo:400:kworker.0 00000100:00100000:3.0:1789265549.827137:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265549.827151:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417599104:0@lo:400:kworker.0 00000100:00100000:1.0:1789265549.827357:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcca955dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417598208:0@lo:400:kworker.0 00000100:00100000:1.0:1789265549.827446:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265549.827463:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417598720:0@lo:400:kworker.0 00000100:00100000:1.0:1789265549.827497:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265549.827522:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417599232:0@lo:400:kworker.0 00000100:00100000:1.0:1789265549.827541:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265549.827559:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789265549.827565:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcca955ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417597824:0@lo:400:kworker.0 00000100:00100000:1.0:1789265549.827589:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265549.827617:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417598336:0@lo:400:kworker.0 00000100:00100000:1.0:1789265549.827636:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265549.827758:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417598080 00000100:00100000:0.0:1789265549.827763:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417598080 00000100:00100000:0.0:1789265549.827803:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417598592 00000100:00100000:0.0:1789265549.827806:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417598592 00000100:00100000:0.0:1789265549.827819:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417598208 00000100:00100000:0.0:1789265549.827821:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417598208 00000100:00100000:0.0:1789265549.827834:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265549.827841:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417598080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265549.827879:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417598080:12345-0@lo:400:kworker.0 Request processed in 38us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265549.827885:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789265549.827898:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265549.827903:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417598592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265549.827923:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417598592:12345-0@lo:400:kworker.0 Request processed in 21us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265549.827929:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789265549.827944:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789265549.827949:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417598208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265549.827971:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417598208:12345-0@lo:400:kworker.0 Request processed in 22us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265549.827977:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789265549.827991:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265549.827993:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265549.828001:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417598720 00000100:00100000:0.0:1789265549.828004:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417598720 00000100:00100000:0.0:1789265549.828041:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417599232 00000100:00100000:0.0:1789265549.828044:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417599232 00000100:00100000:0.0:1789265549.828057:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417598336 00000100:00100000:0.0:1789265549.828059:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417598336 00000100:00100000:0.0:1789265549.828068:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789265549.828074:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417598720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265549.828098:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417598720:12345-0@lo:400:kworker.0 Request processed in 24us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265549.828103:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789265549.828112:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789265549.828116:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417599232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265549.828136:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417599232:12345-0@lo:400:kworker.0 Request processed in 19us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265549.828140:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789265549.828148:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789265549.828152:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417598336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265549.828462:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265549.828501:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcca955ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417598080:0@lo:400:kworker.0 00000100:00100000:3.0:1789265549.828522:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417598592:0@lo:400:kworker.0 00000100:00100000:3.0:1789265549.828536:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789265549.828543:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcca955df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417597952:0@lo:400:kworker.0 00000100:00100000:3.0:1789265549.828567:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265549.828583:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb838f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417598464:0@lo:400:kworker.0 00000100:00100000:3.0:1789265549.828598:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265549.828612:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417598976:0@lo:400:kworker.0 00000100:00100000:3.0:1789265549.828627:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265549.828736:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417598848:0@lo:400:kworker.0 00000100:00100000:1.0:1789265549.828764:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265549.828776:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417599360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265549.828792:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265549.828809:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcca955dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417598208:0@lo:400:kworker.0 00000100:00100000:1.0:1789265549.828817:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417598720:0@lo:400:kworker.0 00010000:00080000:1.0:1789265549.828827:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb8495f100 x1876180417599232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265549.828837:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417599232:0@lo:400:kworker.0 00000100:00100000:2.0:1789265549.828958:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417599360 00000100:00100000:2.0:1789265549.828962:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417599360 00000100:00100000:2.0:1789265549.828983:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265549.828990:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417599360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789265549.829003:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789265549.829053:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417599360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265549.829058:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789265549.829123:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417597824 00000100:00100000:3.0:1789265549.829131:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417597824 00000100:00100000:0.0:1789265549.829197:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417598336:12345-0@lo:400:kworker.0 Request processed in 1043us (1558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265549.829211:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789265549.829233:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417599104 00000100:00100000:0.0:1789265549.829236:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417599104 00000100:00100000:0.0:1789265549.829251:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417598976 00000100:00100000:0.0:1789265549.829253:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417598976 00000100:00100000:0.0:1789265549.829262:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417598848 00000100:00100000:0.0:1789265549.829264:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417598848 00000100:00100000:0.0:1789265549.829274:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789265549.829279:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417599104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265549.829304:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417599104:12345-0@lo:400:kworker.0 Request processed in 25us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265549.829309:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789265549.829318:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789265549.829323:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417598976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265549.829342:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417598976:12345-0@lo:400:kworker.0 Request processed in 20us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265549.829347:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789265549.829355:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789265549.829370:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417598848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265549.829394:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417598848:12345-0@lo:400:kworker.0 Request processed in 34us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265549.829399:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:0.0:1789265549.829418:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265549.829421:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265549.829542:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417599488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265549.829569:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265549.830465:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417599488 00000100:00100000:1.0:1789265549.830476:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417599488 00000100:00100000:1.0:1789265549.830521:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789265549.830529:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417599488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789265549.830546:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789265549.830605:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417599488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265549.830622:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789265549.830703:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417599488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265549.830738:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417597952 00000100:00100000:1.0:1789265549.830741:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417597952 00000100:00100000:1.0:1789265549.830763:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417598464 00000100:00100000:1.0:1789265549.830765:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417598464 00000100:00100000:1.0:1789265549.830777:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789265549.830783:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417597952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265549.830817:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417597952:12345-0@lo:400:kworker.0 Request processed in 34us (2249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265549.830822:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789265549.830832:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789265549.830837:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417598464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265549.830876:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417598464:12345-0@lo:400:kworker.0 Request processed in 39us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265549.830882:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789265549.830911:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcca955df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417597952:0@lo:400:kworker.0 00000100:00100000:1.0:1789265549.830923:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417598464:0@lo:400:kworker.0 00010000:00080000:1.0:1789265549.830937:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb8495d880 x1876180417598976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265549.830947:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417598976:0@lo:400:kworker.0 00000100:00100000:1.0:1789265549.830961:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417599104:0@lo:400:kworker.0 00000100:00100000:2.0:1789265549.831592:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417599360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265549.831625:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb838f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417598336:0@lo:400:kworker.0 00000100:00100000:2.0:1789265549.831636:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417598848:0@lo:400:kworker.0 00000100:00100000:3.0:1789265549.831991:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789265549.832007:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+24:3641:x1876180417597824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265549.832137:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a57aa04c-0472-45c4-bafc-6983957e249b+24:3641:x1876180417597824:12345-0@lo:400:kworker.0 Request processed in 137us (4546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265549.832144:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789265549.832609:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcca955ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417597824:0@lo:400:kworker.0 00000100:00100000:2.0:1789265549.965324:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265549.965915:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265549.970880:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399702272 00000100:00100000:3.0:1789265549.970895:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399702272 00000100:00100000:3.0:1789265549.970985:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399702400 00000100:00100000:3.0:1789265549.970989:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399702400 00000100:00100000:3.0:1789265549.971015:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:3.0:1789265549.971052:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0529895c-e416-4b40-9cbc-d7eabe178719+11:2395:x1876180399702272:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265549.971068:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265549.971087:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb84a2f400/0x9272d942b4a97c6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc1da expref: 11 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265549.971103:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265549.971165:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0529895c-e416-4b40-9cbc-d7eabe178719+10:2395:x1876180399702272:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 142us (5850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265549.971173:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:3.0:1789265549.971191:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:3.0:1789265549.971198:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0529895c-e416-4b40-9cbc-d7eabe178719+9:2395:x1876180399702400:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265549.971205:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265549.971215:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb84a2e800/0x9272d942b4a97c76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc20b expref: 9 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265549.971224:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265549.971260:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0529895c-e416-4b40-9cbc-d7eabe178719+8:2395:x1876180399702400:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 63us (5346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265549.971267:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:0.0:1789265549.974109:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265549.974311:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399702528 00000100:00100000:3.0:1789265549.974319:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399702528 00000100:00100000:3.0:1789265549.974384:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:3.0:1789265549.974395:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0529895c-e416-4b40-9cbc-d7eabe178719+8:2395:x1876180399702528:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265549.974408:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265549.974425:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b6a00/0x9272d942b4a97ced lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc24a expref: 8 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265549.974449:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265549.974497:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0529895c-e416-4b40-9cbc-d7eabe178719+7:2395:x1876180399702528:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 104us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265549.974503:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:2.0:1789265549.978923:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265549.979565:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399702784 00000100:00100000:0.0:1789265549.979575:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399702784 00000100:00080000:2.0:1789265549.982673:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265549.982713:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 69 00000100:00100000:0.0:1789265549.982727:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+6:2392:x1876180399702784:12345-192.168.203.49@tcp:39:umount.0 00000020:00000080:0.0:1789265549.982768:0:17193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97c84 00000020:00010000:0.0:1789265549.982777:0:17193:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fccafac6800: total 0 00000100:00080000:0.0:1789265549.982781:0:17193:0:(import.c:65:import_set_state_nolock()) ffff9fccafac2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789265549.982808:0:17193:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:0.0:1789265549.982983:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2392:x1876180399702784:12345-192.168.203.49@tcp:39:umount.0 Request processed in 259us (4068us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1789265549.982991:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 69 00000020:00010000:2.0:1789265549.983099:0:19586:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fccafac6800: total 0 00010000:00010000:2.0:1789265549.983144:0:19586:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fccafac6800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789265549.983173:0:19586:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fccacd51400) 00010000:00010000:2.0:1789265549.983176:0:19586:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265549.983184:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb84a2fc00/0x9272d942b4a97d79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc274 expref: 4 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265549.983204:0:19586:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fccafac6800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789265549.983215:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265549.983218:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265549.983219:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265549.993970:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265549.994073:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399702912 00000100:00100000:0.0:1789265549.994083:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399702912 00000100:00100000:0.0:1789265549.994148:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 70 00000100:00100000:0.0:1789265549.994158:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32f639db-fb18-46c7-87cd-9f5b45c18fc6+5:2392:x1876180399702912:12345-192.168.203.49@tcp:39:umount.0 00000020:00000080:0.0:1789265549.994197:0:17194:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97c8b 00000100:00080000:0.0:1789265549.994206:0:17194:0:(import.c:65:import_set_state_nolock()) ffff9fccafac7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789265549.994240:0:17194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1789265549.994386:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32f639db-fb18-46c7-87cd-9f5b45c18fc6+3:2392:x1876180399702912:12345-192.168.203.49@tcp:39:umount.0 Request processed in 228us (423us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789265549.994393:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 70 00010000:00010000:3.0:1789265549.994562:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265549.994642:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265550.028776:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265550.029577:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399703168 00000100:00100000:0.0:1789265550.029596:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399703168 00000100:00100000:0.0:1789265550.029663:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 173 00000100:00100000:0.0:1789265550.029673:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccae9b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+7:2392:x1876180399703168:12345-192.168.203.49@tcp:251:umount.0 00000020:00000080:0.0:1789265550.029729:0:17184:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97c22 00000020:00010000:0.0:1789265550.029749:0:17184:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fcb82af7800: total 0 00000100:00080000:0.0:1789265550.029753:0:17184:0:(import.c:65:import_set_state_nolock()) ffff9fcb82af6000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789265550.030989:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccae9b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0529895c-e416-4b40-9cbc-d7eabe178719+3:2392:x1876180399703168:12345-192.168.203.49@tcp:251:umount.0 Request processed in 1313us (2217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265550.031002:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 173 00000020:00010000:1.0:1789265550.034308:0:17180:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fcb82af7800: total 0 00010000:00010000:0.0:1789265550.035280:0:17180:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fcb82af7800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789265550.035320:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a97c29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc163 expref: 2 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265550.035338:0:17180:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fcb82af7800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789265550.035348:0:17180:0:(genops.c:885:class_export_put()) final put ffff9fcb82af7800/0529895c-e416-4b40-9cbc-d7eabe178719 00010000:00010000:0.0:1789265550.035607:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265550.035609:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265550.035611:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789265550.035899:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb82af7800/0529895c-e416-4b40-9cbc-d7eabe178719 for MGS 00000020:00000080:2.0:1789265550.035949:0:17249:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb82af6000 for MGS 00010000:00010000:3.0:1789265550.855251:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265551.875792:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789265551.949597:0:20766:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789265551.967215:0:20766:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789265551.967298:0:20766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a977ec expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.967318:0:20766:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a977ec expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.967350:0:20766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a977ec expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.967358:0:20766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a977ec expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.967374:0:20766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789265551.967380:0:20766:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789265551.967412:0:20766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265551.967418:0:20766:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789265551.967425:0:20766:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789265551.967461:0:20766:0:(import.c:65:import_set_state_nolock()) ffff9fccbf4ee000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789265551.967521:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876180417599616:0@lo:39:umount.0 00010000:00010000:0.0:1789265551.967611:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789265551.967614:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265551.967620:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a977ec expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265551.967629:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4200 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:0.0:1789265551.967633:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a977ec expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265551.967642:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a977ec expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265551.967649:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a977ec expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265551.967654:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789265551.967658:0:17180:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789265551.967667:0:17180:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789265551.967702:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a977ec expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265551.967709:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265551.967737:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a977ec expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265551.967743:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4200/0x9272d942b4a977e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a977ec expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265551.967755:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265551.967757:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265551.967759:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265551.967767:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265551.967777:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417599744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265551.967814:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265551.967866:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417599744 00000100:00100000:0.0:1789265551.967874:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417599744 00000100:00100000:0.0:1789265551.967944:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265551.967954:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a57aa04c-0472-45c4-bafc-6983957e249b+24:3643:x1876180417599744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265551.967969:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265551.967987:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81491800/0x9272d942b4a977ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a977e5 expref: 24 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265551.968002:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265551.968069:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a57aa04c-0472-45c4-bafc-6983957e249b+23:3643:x1876180417599744:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265551.968077:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265551.968124:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417599744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265551.968216:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417599616 00000100:00100000:2.0:1789265551.968220:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417599616 00000100:00100000:2.0:1789265551.968263:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789265551.968270:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876180417599616:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789265551.968310:0:17193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97816 00000100:00080000:2.0:1789265551.968320:0:17193:0:(import.c:65:import_set_state_nolock()) ffff9fccb0929000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789265551.968381:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265551.968389:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1876180417599616:12345-0@lo:39:umount.0 Request processed in 120us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265551.968396:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:2.0:1789265551.968404:0:17193:0:(genops.c:885:class_export_put()) final put ffff9fccbd2af000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1789265551.968465:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbf4ee000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789265551.968484:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876180417599616:0@lo:39:umount.0 00000020:00000080:3.0:1789265551.968534:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbd2af000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789265551.968600:0:17249:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccb0929000 for lustre-MDT0000 00000100:00080000:2.0:1789265551.968719:0:20766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265551.968723:0:20766:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789265551.968728:0:20766:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789265551.969920:0:20766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9773d expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.969965:0:20766:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9773d expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.969973:0:20766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9773d expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.969980:0:20766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9773d expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.970096:0:20766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265551.970104:0:20766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97c1b expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.970112:0:20766:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97c1b expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.970119:0:20766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97c1b expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.970126:0:20766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97c1b expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265551.970199:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265551.970207:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9773d expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265551.970215:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f53c00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:3.0:1789265551.970220:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9773d expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265551.970236:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a9773d expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265551.970244:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a9773d expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265551.970251:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789265551.970253:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1789265551.970302:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9773d expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265551.970309:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789265551.970360:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1789265551.970377:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9773d expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265551.970385:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53c00/0x9272d942b4a97736 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9773d expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265551.970401:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265551.970405:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97c1b expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265551.970410:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe400 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:3.0:1789265551.970413:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97c1b expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265551.970420:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a97c1b expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265551.970427:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a97c1b expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265551.970438:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789265551.970440:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1789265551.970454:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a97c1b expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265551.970460:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789265551.970511:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265551.970534:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417600000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265551.970614:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265551.970685:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417600000 00000100:00100000:1.0:1789265551.970692:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417600000 00000100:00100000:1.0:1789265551.970751:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265551.970760:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a57aa04c-0472-45c4-bafc-6983957e249b+23:3641:x1876180417600000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265551.970776:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265551.970793:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a97c1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a97c14 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265551.970807:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265551.970844:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a57aa04c-0472-45c4-bafc-6983957e249b+22:3641:x1876180417600000:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265551.970851:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265551.970893:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417600000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265551.971163:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417599872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265551.971197:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265551.971231:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417599872 00000100:00100000:0.0:1789265551.971235:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417599872 00000100:00100000:0.0:1789265551.971270:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265551.971360:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa292d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a57aa04c-0472-45c4-bafc-6983957e249b+22:3642:x1876180417599872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265551.971372:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265551.971386:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83f53000/0x9272d942b4a9773d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a97736 expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265551.971401:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265551.971435:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa292d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a57aa04c-0472-45c4-bafc-6983957e249b+21:3642:x1876180417599872:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265551.971442:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265551.971516:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417599872:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265551.971578:0:20766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1789265551.971587:0:20766:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789265551.971598:0:20766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97ce6 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.971606:0:20766:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97ce6 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.971625:0:20766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97ce6 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.971633:0:20766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97ce6 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.971695:0:20766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265551.971702:0:20766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9772f expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.971709:0:20766:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9772f expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.971716:0:20766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9772f expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265551.971722:0:20766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9772f expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265551.971739:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265551.971746:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97ce6 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265551.971764:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7e00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265551.971768:0:19586:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97ce6 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265551.971776:0:19586:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a97ce6 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265551.971782:0:19586:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a97ce6 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265551.971788:0:19586:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789265551.971791:0:19586:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789265551.971793:0:19586:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789265551.971815:0:19586:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a97ce6 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265551.971822:0:19586:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265551.971843:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a97ce6 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265551.971850:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7e00/0x9272d942b4a97cdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a97ce6 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265551.971861:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265551.971864:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9772f expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265551.971870:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52a00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265551.971873:0:19586:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9772f expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265551.971887:0:19586:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a9772f expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265551.971894:0:19586:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a9772f expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265551.971899:0:19586:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265551.971900:0:19586:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1789265551.971914:0:19586:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9772f expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265551.971920:0:19586:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789265551.971926:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9772f expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265551.971934:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265551.971935:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265551.971937:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265551.971948:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a57aa04c-0472-45c4-bafc-6983957e249b:3644:1876180417600256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265551.971985:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265551.972005:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265551.972011:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a57aa04c-0472-45c4-bafc-6983957e249b:3644:1876180417600128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265551.972051:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265551.972076:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417600256 00000100:00100000:1.0:1789265551.972080:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417600256 00000100:00100000:1.0:1789265551.972111:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417600128 00000100:00100000:1.0:1789265551.972115:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417600128 00000100:00100000:1.0:1789265551.972129:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265551.972137:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a57aa04c-0472-45c4-bafc-6983957e249b+22:3644:x1876180417600256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265551.972153:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265551.972164:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83f53200/0x9272d942b4a9772f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a97728 expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265551.972176:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265551.972208:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a57aa04c-0472-45c4-bafc-6983957e249b+21:3644:x1876180417600256:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265551.972215:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265551.972261:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265551.972268:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a57aa04c-0472-45c4-bafc-6983957e249b+20:3644:x1876180417600128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265551.972275:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265551.972406:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a97c1b expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265551.972415:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97c14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a97c1b expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265551.972427:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265551.972429:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265551.972432:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265551.972475:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2ff000/0x9272d942b4a97ce6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a97cdf expref: 20 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265551.972484:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265551.972524:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a57aa04c-0472-45c4-bafc-6983957e249b+19:3644:x1876180417600128:12345-0@lo:103:ldlm_bl.0 Request processed in 256us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265551.972531:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265551.972564:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a57aa04c-0472-45c4-bafc-6983957e249b:3644:1876180417600128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265551.972573:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a57aa04c-0472-45c4-bafc-6983957e249b:3644:1876180417600256:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265551.972641:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265551.972729:0:20766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789265551.972735:0:20766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52a00/0x9272d942b4a97728 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9772f expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265551.972747:0:20766:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1789265551.972752:0:20766:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789265551.972754:0:20766:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789265551.972810:0:20766:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789265551.972815:0:20766:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789265551.972821:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265551.972836:0:20766:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1789265551.972842:0:20766:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fccb6ece800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789265551.972849:0:20766:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fcca93b7800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789265551.972853:0:20766:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fcc85808800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789265551.972858:0:20766:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fcc992fb000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789265551.972866:0:20766:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9fccafac6800 32f639db-fb18-46c7-87cd-9f5b45c18fc6 192.168.203.49@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1789265551.972872:0:20766:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9fcb821eb800 befb0935-501c-4d01-87d3-564eb87bef45 192.168.203.49@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:2.0:1789265551.972878:0:20766:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9fcb8393cd28) has exports, disconnecting them 00000020:00080000:2.0:1789265551.972883:0:20766:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fccb6ece800), last request at 1789265549 00000020:00000080:2.0:1789265551.972891:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97a4d 00000100:00080000:2.0:1789265551.972914:0:20766:0:(import.c:65:import_set_state_nolock()) ffff9fccb6ecb000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789265551.972942:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789265551.973082:0:20766:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fccb6ece800): rc 0 00000020:00000080:2.0:1789265551.973084:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fccb6ece800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789265551.973098:0:20766:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fcca93b7800), last request at 1789265549 00000020:00000080:2.0:1789265551.973102:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a979b3 00000100:00080000:2.0:1789265551.973108:0:20766:0:(import.c:65:import_set_state_nolock()) ffff9fcca93b1800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1789265551.973162:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccb6ece800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789265551.973212:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccb6ecb000 for lustre-MDT0000 00010000:00010000:3.0:1789265551.973454:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789265551.973565:0:20766:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fcca93b7800): rc 0 00000020:00000080:2.0:1789265551.973568:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fcca93b7800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1789265551.973579:0:20766:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fcc85808800), last request at 1789265477 00000020:00000080:2.0:1789265551.973584:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97904 00000100:00080000:2.0:1789265551.973590:0:20766:0:(import.c:65:import_set_state_nolock()) ffff9fcc85809000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1789265551.973614:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcca93b7800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789265551.973654:0:17249:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcca93b1800 for lustre-MDT0000 00010000:00010000:0.0:1789265551.973703:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789265551.973756:0:20766:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fcc85808800): rc 0 00000020:00000080:2.0:1789265551.973759:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fcc85808800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1789265551.973772:0:20766:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fcc992fb000), last request at 1789265477 00000020:00000080:2.0:1789265551.973776:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a978a9 00000100:00080000:2.0:1789265551.973780:0:20766:0:(import.c:65:import_set_state_nolock()) ffff9fcc992fa000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789265551.973815:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc85808800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789265551.973858:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcc85809000 for lustre-MDT0000 00010000:00010000:1.0:1789265551.973910:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789265551.973978:0:20766:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00010000:00010000:3.0:1789265551.974139:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789265551.974236:0:20766:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fcc992fb000): rc 0 00000004:00000080:2.0:1789265551.974244:0:20766:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbf45c19c3ae0 00000100:00080000:2.0:1789265551.974269:0:20766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789265551.974273:0:20766:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789265551.975389:0:20766:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789265551.975430:0:20766:0:(import.c:65:import_set_state_nolock()) ffff9fcb84943800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789265551.975510:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc91421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417600384:0@lo:39:umount.0 00000100:00100000:1.0:1789265551.975602:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265551.975709:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417600384 00000100:00100000:3.0:1789265551.975721:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417600384 00000100:00100000:3.0:1789265551.975798:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789265551.975810:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876180417600384:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789265551.975848:0:17934:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9792e 00000100:00080000:3.0:1789265551.975859:0:17934:0:(import.c:65:import_set_state_nolock()) ffff9fcc82a8a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789265551.975884:0:17934:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:0.0:1789265551.976084:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265551.976566:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3640:x1876180417600384:12345-0@lo:39:umount.0 Request processed in 755us (961us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1789265551.976600:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789265551.976830:0:20766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789265551.976835:0:20766:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1789265551.976856:0:20766:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789265551.976918:0:20766:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789265551.976942:0:20766:0:(import.c:65:import_set_state_nolock()) ffff9fccbf44b800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789265551.976953:0:20766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789265551.976955:0:20766:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1789265551.976976:0:20766:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789265551.977381:0:20766:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789265551.977394:0:20766:0:(import.c:65:import_set_state_nolock()) ffff9fcb8391e800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789265551.977444:0:20766:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fcb8393cd28) has no exports 00000100:00080000:1.0:1789265551.977656:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb84943800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789265551.977666:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc91421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417600384:0@lo:39:umount.0 00000100:00100000:1.0:1789265551.977686:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417600512:0@lo:9:umount.0 00000100:00100000:1.0:1789265551.977748:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265551.977815:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417600640:0@lo:9:umount.0 00000100:00100000:1.0:1789265551.977840:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265551.978659:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417600512 00000100:00100000:0.0:1789265551.978672:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417600512 00000100:00100000:0.0:1789265551.978778:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417600640 00000100:00080000:2.0:1789265551.978781:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265551.978782:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417600640 00000100:00080000:2.0:1789265551.978811:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265551.978959:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265551.978971:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876180417600512:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789265551.979011:0:18700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97a70 00000100:00080000:0.0:1789265551.979042:0:18700:0:(import.c:65:import_set_state_nolock()) ffff9fcb821ed800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789265551.979102:0:18700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789265551.979276:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3640:x1876180417600512:12345-0@lo:9:umount.0 Request processed in 308us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265551.979304:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265551.979323:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265551.979330:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876180417600640:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789265551.979343:0:18700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97a77 00000100:00080000:0.0:1789265551.979349:0:18700:0:(import.c:65:import_set_state_nolock()) ffff9fcb821ef800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789265551.979373:0:18700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1789265551.979611:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3640:x1876180417600640:12345-0@lo:9:umount.0 Request processed in 281us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265551.979619:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1789265551.979654:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789265551.979694:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbf44b800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789265551.979710:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789265551.979713:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789265551.979717:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417600512:0@lo:9:umount.0 00000100:00080000:0.0:1789265551.979729:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb8391e800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789265551.979740:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789265551.979742:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789265551.979749:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417600640:0@lo:9:umount.0 00010000:00010000:2.0:1789265551.979842:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789265551.993591:0:20766:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fcb8393cd28) has no exports 00000020:00000080:3.0:1789265552.084661:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97783 00000020:00000080:3.0:1789265552.084677:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fcb821f5800/lustre-QMT0000_UUID 00000020:01000000:3.0:1789265552.084695:0:20766:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789265552.084809:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb821f5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789265552.084963:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265552.085324:0:20766:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789265552.085330:0:20766:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9fccbf45cd28) has no exports 00000020:00000080:0.0:1789265552.085833:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9777c 00000020:00000080:0.0:1789265552.085841:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fccbf44e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789265552.085919:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf44e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789265552.086339:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265552.086347:0:20766:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789265552.086351:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fccbf550800/lustre-QMT0000_UUID 00000020:00000080:0.0:1789265552.086353:0:20766:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf550800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789265552.086423:0:20766:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1789265552.898549:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265553.922171:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789265553.926651:0:19514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789265553.926661:0:19514:0:(genops.c:885:class_export_put()) final put ffff9fcb821ed000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789265553.926694:0:19514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of befb0935-501c-4d01-87d3-564eb87bef45 00000020:00000080:3.0:1789265553.926697:0:19514:0:(genops.c:885:class_export_put()) final put ffff9fccafac0000/befb0935-501c-4d01-87d3-564eb87bef45 00000020:00000080:1.0:1789265553.926882:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb821ed000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789265553.926943:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccafac0000/befb0935-501c-4d01-87d3-564eb87bef45 for lustre-OST0001 00000020:00000080:1.0:1789265553.926965:0:17249:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb821ef800 for lustre-OST0001 00000020:00000080:1.0:1789265553.926971:0:17249:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccafac1800 for lustre-OST0001 00000001:00100000:0.0:1789265553.930458:0:17926:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789265553.930475:0:17926:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1789265553.930492:0:17926:0:(genops.c:885:class_export_put()) final put ffff9fccad909800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789265553.930514:0:17926:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 32f639db-fb18-46c7-87cd-9f5b45c18fc6 00000001:00080000:0.0:1789265553.930520:0:17926:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1789265553.930522:0:17926:0:(genops.c:885:class_export_put()) final put ffff9fccafac6000/32f639db-fb18-46c7-87cd-9f5b45c18fc6 00000001:00100000:0.0:1789265553.930528:0:17926:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of befb0935-501c-4d01-87d3-564eb87bef45 00000001:00080000:0.0:1789265553.930531:0:17926:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1789265553.930533:0:17926:0:(genops.c:885:class_export_put()) final put ffff9fcb821ef000/befb0935-501c-4d01-87d3-564eb87bef45 00000001:00100000:0.0:1789265553.930582:0:17172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265553.930586:0:17172:0:(genops.c:885:class_export_put()) final put ffff9fcc992fb000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789265553.930592:0:17172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 32f639db-fb18-46c7-87cd-9f5b45c18fc6 00000001:00080000:0.0:1789265553.930596:0:17172:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1789265553.930598:0:17172:0:(genops.c:885:class_export_put()) final put ffff9fccafac6800/32f639db-fb18-46c7-87cd-9f5b45c18fc6 00000001:00100000:0.0:1789265553.930602:0:17172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of befb0935-501c-4d01-87d3-564eb87bef45 00000001:00080000:0.0:1789265553.930606:0:17172:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1789265553.930610:0:17172:0:(genops.c:885:class_export_put()) final put ffff9fcb821eb800/befb0935-501c-4d01-87d3-564eb87bef45 00000020:00000080:3.0:1789265553.930667:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccad909800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1789265553.930729:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccafac6000/32f639db-fb18-46c7-87cd-9f5b45c18fc6 for lustre-MDT0001 00000020:00000080:3.0:1789265553.930751:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb821ef000/befb0935-501c-4d01-87d3-564eb87bef45 for lustre-MDT0001 00000020:00000080:3.0:1789265553.930770:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc992fb000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1789265553.930789:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccafac6800/32f639db-fb18-46c7-87cd-9f5b45c18fc6 for lustre-MDT0000 00000020:00000080:3.0:1789265553.930808:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb821eb800/befb0935-501c-4d01-87d3-564eb87bef45 for lustre-MDT0000 00000020:00000080:3.0:1789265553.930831:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcc82a8a800 for lustre-MDT0001 00000020:00000080:3.0:1789265553.930837:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccafac7000 for lustre-MDT0001 00000020:00000080:3.0:1789265553.930839:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb82c56800 for lustre-MDT0001 00000020:00000080:3.0:1789265553.930843:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcc992fa000 for lustre-MDT0000 00000020:00000080:3.0:1789265553.930845:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccafac2000 for lustre-MDT0000 00000020:00000080:3.0:1789265553.930848:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb821eb000 for lustre-MDT0000 00000020:01000000:0.0:1789265554.113191:0:20766:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fcb83ced060 - data ffff9fcc879256c0/ffff9fccbc1a4000 00000020:01000000:0.0:1789265554.113356:0:20766:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fcc8842f180 - data ffff9fcc87836000/ffff9fccbc93cc00 00000001:00000004:0.0:1789265554.121754:0:20766:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:1.0:1789265554.191603:0:20766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789265554.191611:0:20766:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789265554.191625:0:20766:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9fcc91421f80 x1876180417600384/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789265561 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265554.191651:0:20766:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789265554.196834:0:20766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789265554.196844:0:20766:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1789265554.196862:0:20766:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789265554.196864:0:20766:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789265554.197743:0:17216:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789265554.197750:0:17216:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1789265554.197762:0:17216:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1789265554.198448:0:20766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789265554.198452:0:20766:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1789265554.198471:0:20766:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789265554.198474:0:20766:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789265554.202560:0:17218:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789265554.202567:0:17218:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:2.0:1789265554.202578:0:17218:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1789265554.203942:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9774b 00000020:00000080:1.0:1789265554.203964:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fcc82d4d800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789265554.204536:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc82d4d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789265554.205580:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97760 00000020:00000080:1.0:1789265554.205590:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fccbf4ef000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789265554.205605:0:20766:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789265554.205610:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265554.205618:0:20766:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789265554.205621:0:20766:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9fcb8393b370) has no exports 00000004:01000000:1.0:1789265554.205797:0:20766:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789265554.205805:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a977c2 00000020:00000080:1.0:1789265554.205809:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fccbf4e9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789265554.205813:0:20766:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789265554.205817:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265554.205821:0:20766:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789265554.205823:0:20766:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9fccbf458000) has no exports 00000020:00000080:1.0:1789265554.205829:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a977bb 00000020:00000080:1.0:1789265554.205832:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fcb83918000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789265554.206283:0:20766:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789265554.206288:0:20766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789265554.206291:0:20766:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1789265554.206297:0:20766:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789265554.206299:0:20766:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789265554.206324:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265554.206329:0:20766:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789265554.206335:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a977ad 00000020:00000080:1.0:1789265554.206338:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fcb8391d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789265554.206341:0:20766:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789265554.206344:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265554.206347:0:20766:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789265554.206349:0:20766:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9fccbf4599b8) has no exports 00000020:00000080:1.0:1789265554.206352:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a977a6 00000020:00000080:1.0:1789265554.206355:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fccbf44b000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789265554.206684:0:20766:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000020:00000080:2.0:1789265554.206805:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf4ef000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1789265554.206813:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf4e9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789265554.206818:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb83918000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789265554.206831:0:17249:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb8391e800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789265554.206836:0:17249:0:(genops.c:885:class_export_put()) final put ffff9fcb8391d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789265554.206838:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb8391d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789265554.206841:0:17249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789265554.206940:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb8391d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789265554.206944:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf44b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00080000:1.0:1789265554.207089:0:20766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789265554.207092:0:20766:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1789265554.207096:0:20766:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789265554.207097:0:20766:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789265554.207162:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265554.207168:0:20766:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1789265554.207180:0:20766:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789265554.207185:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97798 00000020:00000080:1.0:1789265554.207190:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fccbf556800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789265554.207443:0:17249:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbf44b800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789265554.207451:0:17249:0:(genops.c:885:class_export_put()) final put ffff9fcb84947000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789265554.207453:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb84947000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789265554.207457:0:17249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789265554.207555:0:20766:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1789265554.207559:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265554.207563:0:20766:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789265554.207566:0:20766:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9fccbd37cd28) has no exports 00000020:00000080:1.0:1789265554.207571:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97791 00000020:00000080:1.0:1789265554.207575:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fcb84946000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789265554.208112:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf556800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789265554.208120:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb84946000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789265554.216189:0:20766:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1789265554.216197:0:20766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789265554.216201:0:20766:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789265554.216208:0:20766:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789265554.216267:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265554.216277:0:20766:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789265554.216305:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265554.216308:0:20766:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789265554.216313:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fcc82d4a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789265554.216318:0:20766:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc82d4a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789265554.216325:0:20766:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789265554.216419:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97767 00000020:00000080:2.0:1789265554.216424:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fccbf4ea800/lustre-MDD0000_UUID 00000020:01000000:2.0:1789265554.216428:0:20766:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789265554.216431:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265554.216435:0:20766:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789265554.216447:0:20766:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9fcb839399b8) has no exports 00000020:00000080:2.0:1789265554.216466:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265554.216469:0:20766:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789265554.216473:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9776e 00000020:00000080:2.0:1789265554.216476:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fccbf4ed800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789265554.216495:0:20766:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fcb83933000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789265554.216498:0:20766:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fcb83933000 3 00000020:01000004:2.0:1789265554.216501:0:20766:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fcb83933000 from lustre-MDT0000 00000020:00000080:2.0:1789265554.216518:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265554.216521:0:20766:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789265554.216523:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fcc82d4c800/lustre-MDT0000_UUID 00000020:00000080:2.0:1789265554.216525:0:20766:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc82d4c800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789265554.216532:0:20766:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789265554.216559:0:20766:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1789265554.216561:0:20766:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789265554.216564:0:20766:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789265554.216566:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265554.216569:0:20766:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789265554.216574:0:20766:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9fccbf553000 a57aa04c-0472-45c4-bafc-6983957e249b 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789265554.216579:0:20766:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9fcb829fb370) has exports, disconnecting them 00000020:00080000:2.0:1789265554.216583:0:20766:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9fccbf553000), last request at 1789265462 00000020:00000080:2.0:1789265554.216597:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97713 00000020:00010000:2.0:1789265554.216600:0:20766:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fccbf553000: total 2 00000100:00080000:2.0:1789265554.216604:0:20766:0:(import.c:65:import_set_state_nolock()) ffff9fccbf551000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789265554.216617:0:20766:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fccbf553000): rc 0 00000020:00080000:2.0:1789265554.216621:0:20766:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9fcb829fb370) has no exports 00000020:00010000:2.0:1789265554.216630:0:19586:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fccbf553000: total 2 00010000:00010000:2.0:1789265554.216633:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265554.216656:0:19586:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fccbf553000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789265554.216686:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb84a2f000/0x9272d942b4a97974 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a9796d expref: 14 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.216715:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b7800/0x9272d942b4a97a0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a97a07 expref: 13 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.216725:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83da4600/0x9272d942b4a97cbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a97cb5 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.216736:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2fe600/0x9272d942b4a97c0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a97c06 expref: 11 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.216749:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83f53600/0x9272d942b4a97832 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a9782b expref: 10 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.216760:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81490e00/0x9272d942b4a978ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a978e8 expref: 9 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.216771:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83f52600/0x9272d942b4a97840 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a97839 expref: 8 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.216782:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83f52000/0x9272d942b4a9784e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a97847 expref: 7 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.216791:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb84a2ea00/0x9272d942b4a97721 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a9771a expref: 6 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.216802:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b7400/0x9272d942b4a9799e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a97997 expref: 5 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.216812:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b6c00/0x9272d942b4a97cca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a97cc3 expref: 4 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.216835:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b7200/0x9272d942b4a97cd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a97cd1 expref: 3 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.216847:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc882b6200/0x9272d942b4a97a38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9272d942b4a97a31 expref: 2 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265554.216858:0:19586:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fccbf553000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1789265554.216876:0:19586:0:(genops.c:885:class_export_put()) final put ffff9fccbf553000/a57aa04c-0472-45c4-bafc-6983957e249b 00010000:00010000:2.0:1789265554.216880:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265554.216882:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265554.216897:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265554.216953:0:17186:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9fccbd26c000:17186] 1 exiting: rc = 0 00000100:00100000:3.0:1789265554.217164:0:17187:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9fccbd2b1400:17187] 2 exiting: rc = 0 00000020:00000080:3.0:1789265554.217218:0:17249:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb84943800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789265554.217226:0:17249:0:(genops.c:885:class_export_put()) final put ffff9fcb84946800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789265554.217235:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb84946800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1789265554.217239:0:17249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789265554.217292:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf4ea800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789265554.217296:0:17249:0:(genops.c:885:class_export_put()) final put ffff9fcc82d4f800/lustre-MDD0000_UUID 00000020:00000080:3.0:1789265554.217298:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc82d4f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789265554.217303:0:17249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789265554.217326:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf4ed800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789265554.217329:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf553000/a57aa04c-0472-45c4-bafc-6983957e249b for MGS 00000020:00000080:3.0:1789265554.217351:0:17249:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbf551000 for MGS 00000100:00100000:3.0:1789265554.217399:0:17184:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9fcc99268800:17184] 0 exiting: rc = 1 00000100:00100000:2.0:1789265554.217488:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217496:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217502:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217507:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217513:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217519:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217524:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217530:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217535:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217540:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217545:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217550:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217557:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217562:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217567:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217573:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217578:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217583:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217588:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217600:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217604:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217609:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217614:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217619:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217624:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217628:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217633:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217638:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217644:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217650:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217656:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217662:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217668:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217673:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217678:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217683:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217688:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217693:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217698:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217703:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217708:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217713:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217718:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217723:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217728:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217733:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217739:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217743:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217749:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217753:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217759:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217764:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217770:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217776:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217789:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217794:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217799:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217804:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217809:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217814:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217822:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217829:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217834:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265554.217839:0:20766:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1789265554.218618:0:20766:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fccbc6aa2a0 - data ffff9fcc99b7b360/ffff9fccbc18b800 00000020:01000000:2.0:1789265554.218742:0:20766:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fcc887fc8a0 - data ffff9fcc878821b0/ffff9fcc846ea400 00000020:00000080:2.0:1789265554.219225:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a976f7 00000020:00000080:2.0:1789265554.219233:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fcb83e0d800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789265554.219276:0:20766:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fcb83933000 from MGS, refs=2 00000020:01000004:2.0:1789265554.219280:0:20766:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fcb83933000 2 00000020:01000004:2.0:1789265554.219283:0:20766:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fcb83933000 from MGS 00000020:00000080:2.0:1789265554.219301:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265554.219307:0:20766:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1789265554.219309:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fcb83e0f000/MGS 00000020:00000080:2.0:1789265554.219311:0:20766:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb83e0f000/MGS for MGS 00000020:01000000:2.0:1789265554.219317:0:20766:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1789265554.219377:0:20766:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1789265554.219380:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265554.219384:0:20766:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789265554.219389:0:20766:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9fccbf4ef800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789265554.219395:0:20766:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9fccbc9c19b8) has exports, disconnecting them 00000020:00080000:2.0:1789265554.219399:0:20766:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9fccbf4ef800), last request at 1789265463 00000020:00000080:2.0:1789265554.219403:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a977fa 00000020:00080000:2.0:1789265554.219410:0:20766:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fccbf4ef800): rc 0 00000020:00000080:2.0:1789265554.219414:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fccbf4ef800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789265554.219468:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb83e0d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789265554.219955:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf4ef800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1789265554.220394:0:20766:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1789265554.220398:0:20766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789265554.220402:0:20766:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789265554.220408:0:20766:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789265554.220422:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbf4ee000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789265554.220559:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265554.220565:0:20766:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1789265554.220569:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fccbf4ec000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789265554.220571:0:20766:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbf4ec000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789265554.220577:0:20766:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1789265554.220636:0:20766:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fcb83933000 1 00000020:00000080:3.0:1789265554.220641:0:20766:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a976e9 00000020:00000080:3.0:1789265554.220645:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fcb83e0e000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1789265554.220651:0:20766:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1789265554.220657:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb83e0e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789265554.220664:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265554.220675:0:20766:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789265554.220679:0:20766:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9fcb83938000) has no exports 00000020:00000080:2.0:1789265554.285155:0:20766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265554.285177:0:20766:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789265554.285183:0:20766:0:(genops.c:885:class_export_put()) final put ffff9fcb83937800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789265554.285187:0:20766:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb83937800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789265554.285200:0:20766:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789265554.285320:0:20766:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fcb83933800 00000020:02000400:2.0:1789265554.285452:0:20766:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1789265554.435301:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265554.435321:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417600768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265554.435449:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265554.435516:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417600768 00000100:00100000:3.0:1789265554.435527:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417600768 00000100:00100000:3.0:1789265554.435579:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789265554.435595:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876180417600768:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1789265554.435602:0:17198:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789265554.435646:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876180417600768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (196us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789265554.435652:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789265554.437321:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:02020000:0.0:1789265554.438703:0:3642:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:1.0:1789265554.440893:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417600896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265554.441886:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265554.442307:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417600896 00000100:00100000:1.0:1789265554.442316:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417600896 00000100:00100000:1.0:1789265554.442377:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789265554.442387:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc91421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417600896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265554.442418:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789265554.442488:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc91421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417600896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265554.442496:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789265554.442519:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265554.442568:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417600896:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789265554.462157:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789265554.462171:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9fccbc7ed000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789265554.462177:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789265554.487663:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9fccbc7ed000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265554.487674:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 528 00000100:00080000:0.0:1789265554.487682:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fccbc7ed000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265554.487717:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fccaa290700 x1876180417601024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265554.487771:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417601024:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789265554.487843:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265554.487897:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417601024 00000100:00100000:0.0:1789265554.487903:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417601024 00000100:00100000:0.0:1789265554.487936:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789265554.487943:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1876180417601024:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1789265554.487962:0:17934:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789265554.512971:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1876180417601024:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 25018us (25119us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789265554.512985:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1789265554.513192:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbc7ed000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265554.513198:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789265554.513202:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417601024:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789265554.945423:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417601152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265554.945533:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265554.945674:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417601152 00000100:00100000:2.0:1789265554.945684:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417601152 00000100:00100000:2.0:1789265554.945774:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789265554.945786:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417601152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265554.945822:0:18703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789265554.945879:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417601152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265554.945887:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789265554.945957:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417601152:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789265554.946151:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789265554.946486:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789265554.946586:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789265554.946591:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789265554.946595:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fccbc7ed000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265554.946601:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 605 00000100:00080000:0.0:1789265554.946613:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789265554.946619:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fccbc7ed000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265554.946643:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83d44a80 x1876180417601408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265554.946730:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417601408:0@lo:38:kworker.0 00000100:00100000:0.0:1789265554.946794:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265554.946835:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417601536:0@lo:400:kworker.0 00000100:00100000:0.0:1789265554.946866:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265554.946886:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417602048:0@lo:400:kworker.0 00000100:00100000:0.0:1789265554.946910:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265554.946929:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789265554.946935:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417601664:0@lo:400:kworker.0 00000100:00100000:0.0:1789265554.946955:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265554.946972:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417602176:0@lo:400:kworker.0 00000100:00100000:0.0:1789265554.946991:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265554.947068:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417601408 00000100:00100000:0.0:1789265554.947075:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417601408 00000100:00100000:0.0:1789265554.947108:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789265554.947115:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1876180417601408:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789265554.947138:0:17197:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789265554.947176:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1876180417601408:12345-0@lo:38:kworker.0 Request processed in 59us (381us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789265554.947183:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789265554.947207:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417601536 00000100:00100000:0.0:1789265554.947211:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417601536 00000100:00100000:0.0:1789265554.947255:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265554.947262:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417601536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265554.947304:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417601536:12345-0@lo:400:kworker.0 Request processed in 44us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265554.947311:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265554.947330:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417602048 00000100:00100000:0.0:1789265554.947333:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417602048 00000100:00100000:0.0:1789265554.947357:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417601664 00000100:00100000:0.0:1789265554.947362:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417601664 00000100:00100000:0.0:1789265554.947370:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417602176 00000100:00100000:0.0:1789265554.947373:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417602176 00000100:00100000:0.0:1789265554.947400:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789265554.947407:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417602176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265554.947444:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417602176:12345-0@lo:400:kworker.0 Request processed in 38us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265554.947450:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789265554.947462:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789265554.947466:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876180417602048:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789265554.947472:0:17194:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789265554.947505:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876180417602048:12345-0@lo:400:kworker.0 Request processed in 37us (594us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265554.947510:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789265554.947522:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789265554.947525:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876180417601664:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789265554.947529:0:17194:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789265554.947551:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876180417601664:12345-0@lo:400:kworker.0 Request processed in 24us (595us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265554.947556:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1789265554.947601:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265554.947632:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccbc7ed000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265554.947637:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789265554.947641:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417601408:0@lo:38:kworker.0 00000100:00080000:0.0:1789265554.947672:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789265554.947677:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9fcc842c7800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789265554.947680:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789265554.947686:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9fcc842c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265554.947690:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 528 00000100:00080000:0.0:1789265554.947695:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9fcc842c7800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265554.947716:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83d44a80 x1876180417602304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265554.947734:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417601664:0@lo:400:kworker.0 00010000:00080000:0.0:1789265554.947748:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9fcb83d47800 x1876180417602176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265554.947758:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417602176:0@lo:400:kworker.0 00000100:00100000:0.0:1789265554.947771:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417601536:0@lo:400:kworker.0 00000100:00080000:0.0:1789265554.947780:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789265554.947783:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9fcb82af0800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789265554.947786:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789265554.947789:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9fcb82af0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265554.947793:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 558 00000100:00080000:0.0:1789265554.947819:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fcb82af0800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265554.947834:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83d47b80 x1876180417602432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265554.947846:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417602048:0@lo:400:kworker.0 00000100:00100000:0.0:1789265554.947869:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876180417602304:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1789265554.947899:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265554.947916:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876180417602432:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1789265554.947936:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265554.947961:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417602304 00000100:00100000:0.0:1789265554.947965:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417602304 00000100:00100000:0.0:1789265554.947985:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417602432 00000100:00100000:0.0:1789265554.947988:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417602432 00000100:00100000:0.0:1789265554.948002:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789265554.948007:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876180417602304:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1789265554.948062:0:17192:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789265554.948094:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876180417602304:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 86us (195us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789265554.948101:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789265554.948115:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789265554.948119:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876180417602432:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1789265554.948129:0:17192:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789265554.948151:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876180417602432:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 30us (214us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789265554.948157:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789265554.948184:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcc842c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265554.948194:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789265554.948197:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876180417602304:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1789265554.948208:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb82af0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265554.948211:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789265554.948214:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876180417602432:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789265554.948485:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a57aa04c-0472-45c4-bafc-6983957e249b:3644:1876180417601280:0@lo:400:kworker.0 00000400:00000100:1.0:1789265554.948520:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876180417601280 offset 0 length 224: 4 00000100:00100000:1.0:1789265554.948551:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417601920:0@lo:400:kworker.0 00000100:00100000:1.0:1789265554.948577:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265554.948605:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265554.948612:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417601792:0@lo:400:kworker.0 00000100:00100000:1.0:1789265554.948635:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265554.949279:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417601920 00000100:00100000:0.0:1789265554.949288:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417601920 00000100:00100000:0.0:1789265554.949388:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417601792 00000100:00100000:0.0:1789265554.949392:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417601792 00000100:00100000:0.0:1789265554.949418:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789265554.949427:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417601920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265554.949505:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417601920:12345-0@lo:400:kworker.0 Request processed in 80us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265554.949513:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789265554.949529:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789265554.949533:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1876180417601792:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789265554.949540:0:19245:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789265554.949562:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1876180417601792:12345-0@lo:400:kworker.0 Request processed in 28us (927us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265554.949568:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1789265554.949619:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789265554.949625:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fcc85928800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789265554.949628:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789265554.949634:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fcc85928800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265554.949638:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 543 00000100:00080000:0.0:1789265554.949657:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fcc85928800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265554.949689:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83d47b80 x1876180417602560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265554.949713:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876180417601792:0@lo:400:kworker.0 00010000:00080000:0.0:1789265554.949729:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9fcb83d46a00 x1876180417601920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265554.949871:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417601920:0@lo:400:kworker.0 00000100:00100000:0.0:1789265554.949907:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876180417602560:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1789265554.949946:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789265554.950515:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265554.950622:0:19245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417602560 00000100:00100000:3.0:1789265554.950629:0:19245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417602560 00000100:00100000:3.0:1789265554.950720:0:19245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789265554.950728:0:19245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1876180417602560:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1789265554.950766:0:19245:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789265554.950839:0:19245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1876180417602560:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 110us (892us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789265554.950847:0:19245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1789265554.951161:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcc85928800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265554.951167:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789265554.951171:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876180417602560:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:0.0:1789265555.969351:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265556.993575:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789265557.512553:0:18696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789265557.512567:0:18696:0:(genops.c:885:class_export_put()) final put ffff9fcb821ea800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789265557.513709:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb821ea800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789265557.513785:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb821ed800 for lustre-OST0000 00000020:01000004:2.0:1789265557.909387:0:20966:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789265557.926217:0:20966:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1789265557.926291:0:20966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a978ef expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.926310:0:20966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a978ef expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.926341:0:20966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a978ef expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.926349:0:20966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a978ef expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.926376:0:20966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789265557.926383:0:20966:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789265557.926425:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265557.926430:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789265557.926437:0:20966:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789265557.926445:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9fcc842c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789265557.926450:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265557.926464:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789265557.926469:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789265557.927705:0:20966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9784e expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.927955:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265557.927966:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a978ef expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.928003:0:20966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9784e expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.932113:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5600 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:3.0:1789265557.932130:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a978ef expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.932149:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a978ef expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265557.932185:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a978ef expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265557.932192:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789265557.932195:0:17180:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789265557.932200:0:17180:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789265557.932263:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a978ef expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.932271:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789265557.932310:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a978ef expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.932317:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5600/0x9272d942b4a978e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a978ef expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265557.932339:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265557.932341:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265557.932345:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265557.932395:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265557.932424:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a57aa04c-0472-45c4-bafc-6983957e249b:3644:1876180417602688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265557.932548:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265557.932929:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417602688 00000100:00100000:3.0:1789265557.932938:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417602688 00000100:00100000:3.0:1789265557.933005:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265557.933013:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1876180417602688:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789265557.933045:0:17179:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789265557 with bad export cookie 10552735757404567315 00010000:00010000:2.0:1789265557.938346:0:20966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9784e expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.938370:0:20966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9784e expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.938441:0:20966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265557.938482:0:20966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97c0d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.938491:0:20966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97c0d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.938497:0:20966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97c0d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.938504:0:20966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97c0d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.940609:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265557.940631:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9784e expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.940646:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491e00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:0.0:1789265557.940651:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9784e expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.940662:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a9784e expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265557.940670:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a9784e expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265557.940676:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789265557.940699:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1789265557.940918:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9784e expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.940925:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789265557.941069:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a57aa04c-0472-45c4-bafc-6983957e249b:3644:1876180417602816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265557.941164:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265557.941283:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9784e expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.941291:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81491e00/0x9272d942b4a97847 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a9784e expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.941309:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265557.941313:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97c0d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.941318:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5800 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:0.0:1789265557.941321:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97c0d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.941328:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a97c0d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265557.941334:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a97c0d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265557.941339:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789265557.941341:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1789265557.941356:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a97c0d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.941363:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265557.941393:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a97c0d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265557.941400:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265557.941402:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265557.941404:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265557.941424:0:17177:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789265557.941433:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789265557.941451:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417602944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265557.941494:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265557.941641:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789265557.941650:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417602816 00000100:00100000:0.0:1789265557.941658:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417602816 00000100:00100000:0.0:1789265557.941694:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789265557.941700:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417602944 00000100:00100000:0.0:1789265557.941703:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417602944 00000100:00100000:0.0:1789265557.942067:0:20967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265557.942076:0:20967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3644:x1876180417602816:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789265557.942083:0:20967:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789265557 with bad export cookie 10552735757404567315 00010000:00010000:2.0:1789265557.944611:0:20966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789265557.944627:0:20966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a97c06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a97c0d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265557.944954:0:20966:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789265557.944986:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265557.945007:0:20966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97cd8 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.945018:0:20966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97cd8 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.945047:0:20966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97cd8 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.945055:0:20966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97cd8 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.945084:0:20966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265557.945110:0:20966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97840 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.945117:0:20966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97840 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.945124:0:20966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97840 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.945130:0:20966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97840 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.945149:0:20966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789265557.945153:0:20966:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1789265557.945158:0:20966:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1789265557.945222:0:20966:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1789265557.945238:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1789265557.945244:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265557.945252:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1789265557.945261:0:20966:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9fcb82af3800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789265557.945267:0:20966:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9fcc842c6800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789265557.945271:0:20966:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9fccbc9c0000) has exports, disconnecting them 00000020:00080000:2.0:1789265557.945277:0:20966:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9fcb82af3800), last request at 1789265554 00000020:00000080:2.0:1789265557.945405:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97a62 00000100:00080000:2.0:1789265557.945550:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9fcb82af4000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789265557.945598:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265557.945605:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97cd8 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.945614:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6800 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265557.945625:0:19586:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97cd8 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.945634:0:19586:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a97cd8 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265557.945641:0:19586:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a97cd8 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265557.945647:0:19586:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789265557.945650:0:19586:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789265557.945651:0:19586:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789265557.945865:0:19586:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a97cd8 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.945874:0:19586:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265557.945903:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a97cd8 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.945910:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b6800/0x9272d942b4a97cd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a97cd8 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.945922:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265557.945926:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97840 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.945931:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491000 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265557.945935:0:19586:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97840 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.945942:0:19586:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a97840 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265557.945956:0:19586:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a97840 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265557.945963:0:19586:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789265557.945965:0:19586:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789265557.945967:0:19586:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789265557.945981:0:19586:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a97840 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.945987:0:19586:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265557.946000:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a97840 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.946007:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81491000/0x9272d942b4a97839 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9272d942b4a97840 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265557.946044:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265557.946046:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265557.946049:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789265557.946067:0:20966:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fcb82af3800): rc 0 00000020:00000080:2.0:1789265557.946070:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fcb82af3800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1789265557.946084:0:20966:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9fcc842c6800), last request at 1789265554 00000020:00000080:2.0:1789265557.946089:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a979c8 00000100:00080000:2.0:1789265557.946095:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9fcc842c4800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1789265557.946110:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb82af3800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00100000:0.0:1789265557.946182:0:20967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3644:x1876180417602816:12345-0@lo:103:ldlm_bl.0 Request processed in 4100us (5012us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265557.946196:0:20967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1789265557.946233:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265557.946256:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417603072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265557.946335:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265557.946407:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417603200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265557.946435:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265557.946497:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417603072 00000100:00100000:0.0:1789265557.946507:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417603072 00000100:00100000:0.0:1789265557.946554:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417603200 00000020:00000080:2.0:1789265557.946559:0:17249:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb82af4000 for lustre-MDT0001 00000100:00100000:0.0:1789265557.946559:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417603200 00000100:00100000:0.0:1789265557.946580:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1789265557.946581:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265557.946591:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1876180417602944:12345-0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789265557.946596:0:20966:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fcc842c6800): rc 0 00000020:00000080:2.0:1789265557.946601:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fcc842c6800/lustre-MDT0001-lwp-OST0000_UUID 00010000:00020000:0.0:1789265557.946602:0:17178:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789265557 with bad export cookie 10552735757404567315 00000004:00000080:2.0:1789265557.946623:0:20966:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbf45c1d83ae0 00000020:00000080:2.0:1789265557.946640:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc842c6800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00100000:0.0:1789265557.946661:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1876180417602944:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (5165us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265557.946669:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265557.946684:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265557.946689:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1876180417603072:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789265557.946693:0:17178:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789265557 with bad export cookie 10552735757404567315 00000100:00100000:0.0:1789265557.946739:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1876180417603072:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (405us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265557.946746:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000020:00000080:2.0:1789265557.946779:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcc842c4800 for lustre-MDT0001 00000100:00080000:2.0:1789265557.946812:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265557.946822:0:20966:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9fccaa291880 x1876180417600768/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789265570 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265557.946833:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1789265557.946837:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265557.946846:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1876180417603200:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789265557.946923:0:17178:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789265557 with bad export cookie 10552735757404567315 00000100:00100000:0.0:1789265557.946959:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1876180417603200:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (524us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789265557.946966:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789265557.947115:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.149@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789265557.947121:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9fccb0e1d000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789265557.947125:0:3641:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1789265557.948109:0:20966:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789265557.948119:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9fccbc7ed000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1789265557.949370:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265557.950977:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.149@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789265557.951684:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789265557.951703:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1789265557.951724:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789265557.951796:0:20966:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1789265557.951815:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1876180417602688:12345-0@lo:103:ldlm_bl.0 Request processed in 18795us (19261us total) trans 0 rc -107/-107 00000100:00080000:2.0:1789265557.951827:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9fcb83c79800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789265557.951832:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789265557.951849:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789265557.951851:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1789265557.951861:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789265557.951927:0:20966:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789265557.951936:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9fccad90f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789265557.951977:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9fccbc9c0000) has no exports 00000100:00080000:2.0:1789265557.957324:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.149@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789265557.959839:0:3641:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.149@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789265557.959847:0:3641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789265557.959917:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fccaa291180 x1876180417601280/t0(0) o400->MGC192.168.203.149@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789265570 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265557.959966:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb8495c700 x1876180417602688/t0(0) o103->MGC192.168.203.149@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789265573 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265557.959976:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83d45180 x1876180417602816/t0(0) o103->MGC192.168.203.149@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789265573 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265557.959985:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83d44a80 x1876180417602944/t0(0) o103->MGC192.168.203.149@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789265573 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265557.960097:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83c9bb80 x1876180417603072/t0(0) o103->MGC192.168.203.149@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789265573 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265557.960109:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83c98380 x1876180417603200/t0(0) o103->MGC192.168.203.149@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789265573 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789265557.960122:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789265557.960125:0:3641:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789265557.960126:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789265557.960366:0:3644:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9fccb0e1d000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1789265557.960403:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a57aa04c-0472-45c4-bafc-6983957e249b:3644:1876180417602688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265557.960414:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a57aa04c-0472-45c4-bafc-6983957e249b:3644:1876180417601280:0@lo:400:kworker.0 00000100:00100000:1.0:1789265557.960474:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a57aa04c-0472-45c4-bafc-6983957e249b:3644:1876180417602816:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789265557.960509:0:3643:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9fccb0e1d000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1789265557.960517:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417603328:0@lo:9:umount.0 00000100:00100000:2.0:1789265557.960528:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a57aa04c-0472-45c4-bafc-6983957e249b:3643:1876180417603200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265557.960582:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a57aa04c-0472-45c4-bafc-6983957e249b:3642:1876180417603072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265557.960591:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417600768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265557.960609:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265557.960666:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417603456:0@lo:9:umount.0 00000100:00100000:1.0:1789265557.960693:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265557.960964:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417603328 00000100:00100000:2.0:1789265557.960975:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417603328 00000100:00100000:1.0:1789265557.960978:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417603456 00000100:00100000:1.0:1789265557.960984:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417603456 00000100:00100000:2.0:1789265557.962925:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265557.962948:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876180417603328:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789265557.962997:0:18701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a979f2 00000100:00080000:2.0:1789265557.963013:0:18701:0:(import.c:65:import_set_state_nolock()) ffff9fcb82c55000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789265557.963104:0:18701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789265557.963105:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789265557.963117:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876180417603456:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789265557.963132:0:18702:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97a7e 00000100:00080000:1.0:1789265557.963139:0:18702:0:(import.c:65:import_set_state_nolock()) ffff9fcb821ee800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789265557.963172:0:18702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1789265557.963448:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3640:x1876180417603456:12345-0@lo:9:umount.0 Request processed in 333us (2752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265557.963471:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1789265557.963502:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265557.963507:0:17188:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789265557.963523:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789265557.963565:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccad90f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789265557.963580:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789265557.963583:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789265557.963587:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417603456:0@lo:9:umount.0 00000100:00080000:0.0:1789265557.964254:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9fccb0e1d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265557.964472:0:3641:0:(import.c:510:import_select_connection()) MGC192.168.203.149@tcp: connect to NID 0@lo last attempt 514 00000100:00080000:0.0:1789265557.964485:0:3641:0:(import.c:624:import_select_connection()) MGC192.168.203.149@tcp: import ffff9fccb0e1d000 using connection 192.168.203.149@tcp/0@lo 00010000:00010000:0.0:1789265557.964497:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265557.964540:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83d44700 x1876180417603584/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265557.964605:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a57aa04c-0472-45c4-bafc-6983957e249b:3640:1876180417603584:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1789265557.964652:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876180417603584 offset 0 length 520: 4 00000100:00100000:0.0:1789265557.964843:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a57aa04c-0472-45c4-bafc-6983957e249b:3641:1876180417602944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265557.964989:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3640:x1876180417603328:12345-0@lo:9:umount.0 Request processed in 2050us (4380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265557.965000:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789265557.965185:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb83c79800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789265557.965249:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789265557.965320:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789265557.965326:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417603328:0@lo:9:umount.0 00000020:00080000:0.0:1789265557.975261:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9fccbc9c0000) has no exports 00010000:00010000:2.0:1789265558.017200:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789265558.061088:0:20966:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fcb83ced840 - data ffff9fcc99b4a438/ffff9fccbc1a7000 00000020:01000000:1.0:1789265558.061272:0:20966:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fcb82309d20 - data ffff9fcc87aca948/ffff9fccae77d400 00000001:00000004:1.0:1789265558.078197:0:20966:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1789265558.155941:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265558.155952:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789265558.155961:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789265558.161671:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789265558.161681:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1789265558.161858:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789265558.161862:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789265558.163462:0:17935:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789265558.163470:0:17935:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1789265558.163496:0:17935:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1789265558.165197:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789265558.165209:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1789265558.165230:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789265558.165234:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789265558.165509:0:17937:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789265558.165515:0:17937:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1789265558.165526:0:17937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1789265558.167925:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9785c 00000020:00000080:2.0:1789265558.167943:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fcc9950a000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789265558.168880:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc9950a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789265558.169606:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97871 00000020:00000080:1.0:1789265558.169620:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fcc86771800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789265558.169747:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1789265558.169755:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265558.169768:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789265558.169774:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9fccbc9c4d28) has no exports 00000004:01000000:1.0:1789265558.170192:0:20966:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789265558.170205:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a978c5 00000020:00000080:1.0:1789265558.170211:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fccad90a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265558.170264:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc86771800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1789265558.174357:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789265558.174379:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265558.174396:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789265558.174404:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9fcb829fcd28) has no exports 00000020:00000080:1.0:1789265558.174416:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a978be 00000020:00000080:1.0:1789265558.174427:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fccad90a000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1789265558.175011:0:20966:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789265558.175018:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789265558.175051:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1789265558.175060:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789265558.175063:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789265558.175117:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265558.175126:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789265558.175136:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a978b0 00000020:00000080:1.0:1789265558.175144:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fccad90e800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789265558.175151:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789265558.175156:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265558.175161:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789265558.175163:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9fcc8428b370) has no exports 00000020:00000080:1.0:1789265558.175169:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a978a2 00000020:00000080:1.0:1789265558.175174:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fcb83c7f000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1789265558.175587:0:20966:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789265558.175605:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789265558.175608:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1789265558.175613:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789265558.175614:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789265558.175648:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265558.175653:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1789265558.175668:0:20966:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789265558.175675:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97894 00000020:00000080:1.0:1789265558.175682:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fcca1be5800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789265558.175687:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1789265558.175691:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265558.175694:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789265558.175697:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9fcc837e99b8) has no exports 00000020:00000080:1.0:1789265558.175702:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9788d 00000020:00000080:1.0:1789265558.175704:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fccbc7ef000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789265558.176603:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccad90a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789265558.176623:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccad90a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789265558.176630:0:17249:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccad90f000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789265558.176637:0:17249:0:(genops.c:885:class_export_put()) final put ffff9fccad908000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265558.176640:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccad908000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789265558.176644:0:17249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789265558.176765:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccad90e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789265558.176773:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb83c7f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789265558.176778:0:17249:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb83c79800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789265558.176783:0:17249:0:(genops.c:885:class_export_put()) final put ffff9fcc86775800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265558.176785:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc86775800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789265558.176789:0:17249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789265558.176818:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcca1be5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789265558.176823:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc7ef000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789265558.177532:0:20966:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789265558.177540:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789265558.177544:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789265558.177552:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789265558.177611:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265558.177624:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789265558.177658:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265558.177660:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789265558.177665:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fcc82d49000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265558.177684:0:20966:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc82d49000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789265558.177691:0:20966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789265558.177834:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97878 00000020:00000080:0.0:1789265558.177844:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fcc86775000/lustre-MDD0001_UUID 00000020:01000000:0.0:1789265558.177849:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789265558.177853:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265558.177859:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789265558.177863:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9fccbc9c3370) has no exports 00000020:00000080:0.0:1789265558.177885:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265558.177888:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789265558.177891:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9787f 00000020:00000080:0.0:1789265558.177895:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fcc86771000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789265558.177904:0:20966:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fccaa073800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789265558.177907:0:20966:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccaa073800 2 00000020:01000004:0.0:1789265558.177911:0:20966:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fccaa073800 from lustre-MDT0001 00000020:00000080:0.0:1789265558.177942:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265558.177946:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789265558.177949:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fcc99508000/lustre-MDT0001_UUID 00000020:00000080:0.0:1789265558.177952:0:20966:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc99508000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789265558.177958:0:20966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789265558.177988:0:20966:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789265558.178002:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789265558.178005:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265558.178009:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789265558.178017:0:20966:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9fcc8592e800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789265558.178044:0:20966:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9fccbd3799b8) has exports, disconnecting them 00000020:00080000:0.0:1789265558.178050:0:20966:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9fcc8592e800), last request at 1789265477 00000020:00000080:0.0:1789265558.178055:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a978fd 00000020:00080000:0.0:1789265558.178069:0:20966:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fcc8592e800): rc 0 00000020:00000080:0.0:1789265558.178073:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fcc8592e800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789265558.179329:0:17249:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccbc7ed000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1789265558.179348:0:17249:0:(genops.c:885:class_export_put()) final put ffff9fcc9900a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789265558.179351:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc9900a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1789265558.179368:0:17249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789265558.179545:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc86775000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1789265558.179551:0:17249:0:(genops.c:885:class_export_put()) final put ffff9fcca1be0000/lustre-MDD0001_UUID 00000020:00000080:2.0:1789265558.179553:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcca1be0000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1789265558.179557:0:17249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1789265558.179683:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc86771000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789265558.179689:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc8592e800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1789265558.204127:0:20966:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1789265558.204141:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265558.204146:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789265558.204157:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789265558.204197:0:17249:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcc842c7800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789265558.204412:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265558.204424:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1789265558.204431:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fcc842c0800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1789265558.204436:0:20966:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc842c0800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1789265558.204448:0:20966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1789265558.204558:0:20966:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccaa073800 1 00000020:00000080:2.0:1789265558.204566:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97824 00000020:00000080:2.0:1789265558.204574:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fcc82a8c000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1789265558.204584:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1789265558.204593:0:17249:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc82a8c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789265558.204602:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265558.204608:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789265558.204612:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9fccbf45b370) has no exports 00000020:00000080:2.0:1789265558.292676:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265558.292696:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1789265558.292704:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fccaa075000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789265558.292710:0:20966:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccaa075000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789265558.292719:0:20966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1789265558.292874:0:20966:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fccaa073000 00000020:01000000:2.0:1789265558.292899:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789265558.292904:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265558.292909:0:20966:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789265558.292914:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9fccbd37b370) has no exports 00000100:00100000:1.0:1789265558.293575:0:19245:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9fcb83d71800:19245] 3 exiting: rc = 0 00000100:00100000:0.0:1789265558.293805:0:17194:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9fccaa22a400:17194] 2 exiting: rc = 0 00000100:00100000:2.0:1789265558.294117:0:17193:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9fcc8676da00:17193] 1 exiting: rc = 0 00000100:00100000:3.0:1789265558.294765:0:17192:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9fcc8676d200:17192] 0 exiting: rc = 1 00000100:00100000:3.0:1789265558.294850:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294869:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294875:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294881:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294888:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294894:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294900:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294907:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294913:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294924:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294932:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294938:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294943:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294949:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294956:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294963:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294970:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294977:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294983:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.294988:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295007:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295014:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295020:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295051:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295059:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295067:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295076:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295083:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295090:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295097:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295104:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295111:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295117:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295123:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295131:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295139:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295153:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295160:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295166:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295173:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295180:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295187:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295196:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295203:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295210:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295217:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295235:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295242:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295249:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295533:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295541:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295548:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295555:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295562:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295569:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295575:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295581:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295588:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295595:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295603:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295610:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295616:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295624:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.295631:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265558.304730:0:17195:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9fcc98f49600:17195] 0 exiting: rc = 1 00000100:00100000:3.0:1789265558.304878:0:17196:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9fccad903000:17196] 1 exiting: rc = 0 00000100:00100000:3.0:1789265558.304942:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.304953:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.304960:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.304966:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.304972:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.304977:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305195:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305201:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305208:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305213:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305227:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305234:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305240:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305247:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305375:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305384:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305391:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305397:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305404:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305409:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305415:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305421:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305427:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305432:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305438:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305444:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305459:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305466:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305474:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305479:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305485:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305491:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305497:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305503:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305509:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305514:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305520:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305525:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305531:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305537:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305543:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305558:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305564:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305569:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305576:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305581:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305587:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305592:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305598:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305604:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305610:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305616:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305623:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305629:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305637:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305642:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305648:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305654:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305660:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305666:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305672:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305678:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305684:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.305689:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.306663:0:17934:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9fcc84273800:17934] 2 exiting: rc = 0 00000100:00100000:0.0:1789265558.306813:0:17197:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9fcb83c64c00:17197] 0 exiting: rc = 1 00000100:00100000:0.0:1789265558.306892:0:17198:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9fcb83c65e00:17198] 1 exiting: rc = 0 00000100:00100000:3.0:1789265558.307172:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307192:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307200:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307207:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307215:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307362:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307371:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307379:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307387:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307394:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307402:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307409:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307433:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307469:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307476:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307483:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307489:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307496:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307504:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307511:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307518:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307527:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307535:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307541:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307548:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307569:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307576:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307583:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307589:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307595:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307601:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307607:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307614:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307620:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307627:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307633:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307640:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307662:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307670:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307676:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307683:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307690:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307697:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307703:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307710:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307717:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307723:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307736:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307743:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307764:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307772:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307778:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307785:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307791:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307798:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307805:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307812:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307820:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307827:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307833:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307839:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307845:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307852:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265558.307859:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.324695:0:17200:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9fccaa386e00:17200] 1 exiting: rc = 0 00000100:00100000:3.0:1789265558.324858:0:17199:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9fccaa387a00:17199] 0 exiting: rc = 1 00000100:00100000:0.0:1789265558.324933:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.324941:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.324947:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.324952:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.324958:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.324963:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.324969:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.324975:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.324981:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.324988:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325432:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325443:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325449:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325465:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325471:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325476:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325482:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325488:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325494:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325499:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325504:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325509:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325515:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325520:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325525:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325531:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325536:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325541:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325546:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325551:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325556:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325578:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325583:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325588:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325593:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325599:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325605:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325611:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325617:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325622:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325627:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325632:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325638:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325643:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325647:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325652:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325657:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325662:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325666:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325671:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325676:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325680:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325686:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325690:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325695:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325700:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325705:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325710:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325715:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325720:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325725:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325730:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325735:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.325740:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.326269:0:17202:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9fcc90a44c00:17202] 1 exiting: rc = 0 00000100:00100000:2.0:1789265558.326730:0:17201:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9fcc83241400:17201] 0 exiting: rc = 1 00000100:00100000:0.0:1789265558.327282:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327292:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327311:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327316:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327322:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327327:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327333:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327338:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327344:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327350:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327355:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327360:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327366:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327371:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327375:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327381:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327386:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327392:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327397:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327403:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327408:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327414:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327420:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327425:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327432:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327437:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327443:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327448:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327462:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327468:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327473:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327478:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327484:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327488:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327494:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327500:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327505:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327518:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327524:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327531:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327536:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327542:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327547:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327553:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327559:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327565:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327571:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327576:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327582:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327588:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327593:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327599:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327605:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327609:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327614:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327619:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327624:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327629:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327634:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327639:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327645:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327650:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327655:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789265558.327661:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.328681:0:17204:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9fccad903e00:17204] 1 exiting: rc = 0 00000100:00100000:3.0:1789265558.328918:0:17203:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9fcc90a44400:17203] 0 exiting: rc = 1 00000100:00100000:1.0:1789265558.329016:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329081:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329088:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329094:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329100:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329106:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329111:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329117:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329123:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329129:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329135:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329141:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329146:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329152:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329170:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329176:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329181:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329187:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329192:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329197:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329203:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329208:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329214:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329428:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329437:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329443:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329448:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329463:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329469:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329476:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329481:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329486:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329491:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329497:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329504:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329510:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329516:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329522:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329528:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329534:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329541:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329547:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329554:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329560:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329566:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329572:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329578:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329583:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329589:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329604:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329608:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329614:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329620:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329625:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329630:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329636:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329641:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329646:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329652:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329657:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329662:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329666:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329671:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.329676:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265558.330774:0:17205:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9fcc93c4e400:17205] 0 exiting: rc = 1 00000100:00100000:3.0:1789265558.331334:0:17206:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9fccbc4cf800:17206] 1 exiting: rc = 0 00000100:00100000:3.0:1789265558.331548:0:17207:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9fccb0be1400:17207] 2 exiting: rc = 0 00000100:00100000:1.0:1789265558.331759:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331768:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331774:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331780:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331808:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331816:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331822:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331828:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331834:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331840:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331846:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331852:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331858:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331865:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331870:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331876:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331883:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331889:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331896:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331902:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331922:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331928:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331934:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331940:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331946:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331953:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331959:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331966:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.331990:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332006:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332014:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332093:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332102:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332108:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332115:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332122:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332128:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332135:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332140:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332147:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332153:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332159:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332164:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332170:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332177:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332182:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332189:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332195:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332201:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332206:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332212:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332231:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332253:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332261:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332267:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332283:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332290:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332297:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332304:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332310:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332316:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332321:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332327:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265558.332340:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789265558.339877:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265558.339896:0:20966:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789265558.339903:0:20966:0:(genops.c:885:class_export_put()) final put ffff9fcb84945800/MDS_uuid 00000020:00000080:0.0:1789265558.339909:0:20966:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb84945800/MDS_uuid for MDS 00000020:01000000:0.0:1789265558.339920:0:20966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789265558.340168:0:20966:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1789265559.041181:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265560.065262:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) a57aa04c-0472-45c4-bafc-6983957e249b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789265560.065273:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) a57aa04c-0472-45c4-bafc-6983957e249b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265560.065276:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789265560.065280:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789265560.065284:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcc85928800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265560.065292:0:17249:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 606 00000100:00080000:2.0:1789265560.065298:0:17249:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789265560.065305:0:17249:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fcc85928800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265560.065345:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83c9bb80 x1876180417603712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265560.065418:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789265560.065421:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789265560.065423:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcb82af0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265560.065427:0:17249:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 606 00000100:00080000:2.0:1789265560.065430:0:17249:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789265560.065433:0:17249:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fcb82af0800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265560.065456:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83c9b800 x1876180417603968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265560.065496:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265560.065512:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417603840:0@lo:400:kworker.0 00000400:00000100:2.0:1789265560.065561:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417603840 offset 0 length 224: 4 00000100:00100000:1.0:1789265560.065709:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876180417603712:0@lo:38:kworker.0 00000400:00000100:1.0:1789265560.065734:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417603712 offset 0 length 520: 4 00000100:00100000:1.0:1789265560.065763:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876180417603968:0@lo:38:kworker.0 00000400:00000100:1.0:1789265560.065778:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417603968 offset 0 length 520: 4 00000100:00100000:2.0:1789265560.065858:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265560.065866:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417604096:0@lo:400:kworker.0 00000400:00000100:2.0:1789265560.065887:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417604096 offset 0 length 224: 4 00010000:00010000:1.0:1789265560.066390:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265561.089202:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265562.114130:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789265562.168075:0:21169:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789265562.188175:0:21169:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789265562.188236:0:21169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a97997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9799e expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.188250:0:21169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a97997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9799e expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.188259:0:21169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a97997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9799e expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.188267:0:21169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a97997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a9799e expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265562.188293:0:21169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789265562.188298:0:21169:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789265562.188332:0:21169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265562.188343:0:21169:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83c9bb80 x1876180417603712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265575 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265562.188371:0:21169:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789265562.188378:0:21169:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789265562.188384:0:21169:0:(import.c:65:import_set_state_nolock()) ffff9fcc85928800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789265562.188389:0:21169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265562.188393:0:21169:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83c9bb80 x1876180417603712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265575 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265562.188418:0:21169:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789265562.188421:0:21169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:3.0:1789265562.188516:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876180417603712:0@lo:38:kworker.0 00010000:00010000:1.0:1789265562.188603:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265562.188610:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a97997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9799e expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.188617:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7600 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265562.188631:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a97997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a9799e expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.188641:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a97997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a9799e expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265562.188649:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a97997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a9799e expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265562.188654:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265562.188656:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789265562.188665:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789265562.188679:0:17181:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fccb0e1d000 00010000:00010000:1.0:1789265562.188683:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a97997 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a9799e expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.188690:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc882b7600/0x9272d942b4a97997 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a9799e expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265562.188710:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265562.188712:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265562.188713:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265562.189581:0:21169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789265562.189590:0:21169:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83c98380 x1876180417603840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265576 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265562.189618:0:21169:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789265562.189623:0:21169:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789265562.189642:0:21169:0:(import.c:65:import_set_state_nolock()) ffff9fcc992fc800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789265562.189874:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417603840:0@lo:400:kworker.0 00000100:00100000:0.0:1789265562.190228:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1876180417604224:0@lo:39:umount.0 00000400:00000100:0.0:1789265562.190277:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417604224 offset 0 length 224: 4 00000100:00080000:1.0:1789265563.073300:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a57aa04c-0472-45c4-bafc-6983957e249b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265563.073310:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a57aa04c-0472-45c4-bafc-6983957e249b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265563.073313:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265563.073317:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789265563.073520:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265563.073550:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417604352:0@lo:400:kworker.0 00000400:00000100:0.0:1789265563.073611:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417604352 offset 0 length 224: 4 00010000:00010000:2.0:1789265563.137225:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789265563.657384:0:19514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789265563.657397:0:19514:0:(genops.c:885:class_export_put()) final put ffff9fcb821ec800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789265563.657503:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb821ec800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789265563.657586:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb821ee800 for lustre-OST0001 00000001:00100000:0.0:1789265563.657697:0:18696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789265563.657702:0:18696:0:(genops.c:885:class_export_put()) final put ffff9fcb82c50800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789265563.662401:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb82c50800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789265563.662486:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb82c55000 for lustre-OST0000 00010000:00010000:3.0:1789265564.162573:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265565.122970:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) a57aa04c-0472-45c4-bafc-6983957e249b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789265565.122985:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) a57aa04c-0472-45c4-bafc-6983957e249b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265565.122988:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789265565.122992:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789265565.123208:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417604480:0@lo:400:kworker.0 00000400:00000100:3.0:1789265565.123276:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417604480 offset 0 length 224: 4 00010000:00010000:1.0:1789265565.185537:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265566.209223:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265567.233226:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265567.297976:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265557/real 1789265557] req@ffff9fcb83d44700 x1876180417603584/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789265567 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265567.298011:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83d44700 x1876180417603584/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789265567 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789265567.298048:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccb0e1d000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265567.298078:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789265567.298082:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a57aa04c-0472-45c4-bafc-6983957e249b:3640:1876180417603584:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1789265567.298174:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) a57aa04c-0472-45c4-bafc-6983957e249b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265567.298179:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789265567.298182:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fccb0e1d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265567.298187:0:17249:0:(import.c:510:import_select_connection()) MGC192.168.203.149@tcp: connect to NID 0@lo last attempt 609 00000100:00080000:1.0:1789265567.298191:0:17249:0:(import.c:589:import_select_connection()) MGC192.168.203.149@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789265567.298198:0:17249:0:(import.c:624:import_select_connection()) MGC192.168.203.149@tcp: import ffff9fccb0e1d000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265567.298229:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb84844000 x1876180417604608/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265567.298269:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789265567.298273:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789265567.298399:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265567.298424:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417604736:0@lo:400:kworker.0 00000400:00000100:2.0:1789265567.298476:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417604736 offset 0 length 224: 4 00000100:00100000:0.0:1789265567.299716:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a57aa04c-0472-45c4-bafc-6983957e249b:3640:1876180417604608:0@lo:250:kworker.0 00000400:00000100:0.0:1789265567.299757:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876180417604608 offset 0 length 520: 4 00010000:00010000:1.0:1789265568.257687:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265569.281316:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265570.305870:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265571.329285:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265572.353445:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789265572.354661:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) a57aa04c-0472-45c4-bafc-6983957e249b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789265572.354697:0:14028:0:(pinger.c:247:ptlrpc_pinger_process_import()) a57aa04c-0472-45c4-bafc-6983957e249b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265572.354700:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789265572.354704:0:14028:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789265572.354834:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417604864:0@lo:400:kworker.0 00000400:00000100:0.0:1789265572.354910:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417604864 offset 0 length 224: 4 00000100:00100000:0.0:1789265572.417422:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265562/real 1789265562] req@ffff9fcb83c98700 x1876180417604224/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789265572 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265572.417474:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83c98700 x1876180417604224/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789265572 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789265572.417498:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcc992fc800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789265572.417523:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1876180417604224:0@lo:39:umount.0 00000100:00080000:2.0:1789265572.417672:0:21169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789265572.417679:0:21169:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789265572.417685:0:21169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789265572.418690:0:21169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52200/0x9272d942b4a9796d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97974 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265572.418730:0:21169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52200/0x9272d942b4a9796d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97974 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265572.418740:0:21169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52200/0x9272d942b4a9796d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97974 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265572.418748:0:21169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52200/0x9272d942b4a9796d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97974 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265572.418781:0:21169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265572.418789:0:21169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f800/0x9272d942b4a97cc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97cca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265572.418796:0:21169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f800/0x9272d942b4a97cc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97cca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265572.418803:0:21169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f800/0x9272d942b4a97cc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97cca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265572.418809:0:21169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f800/0x9272d942b4a97cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97cca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265572.418832:0:21169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789265572.418837:0:21169:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789265572.418878:0:21169:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789265572.418883:0:21169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789265572.418889:0:21169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265572.418896:0:21169:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789265572.418900:0:21169:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9fcc842899b8) has no exports 00000020:00080000:2.0:1789265572.418937:0:21169:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9fcc842899b8) has no exports 00010000:00010000:1.0:1789265572.419169:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265572.419180:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52200/0x9272d942b4a9796d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97974 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265572.419189:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52200 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265572.419194:0:19586:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52200/0x9272d942b4a9796d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97974 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265572.419204:0:19586:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52200/0x9272d942b4a9796d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a97974 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265572.419212:0:19586:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52200/0x9272d942b4a9796d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a97974 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265572.419219:0:19586:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789265572.419221:0:19586:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789265572.419224:0:19586:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789265572.419242:0:19586:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fccb0e1d000 00010000:00010000:1.0:1789265572.419246:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52200/0x9272d942b4a9796d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a97974 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265572.419253:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52200/0x9272d942b4a9796d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a97974 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265572.419294:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265572.419298:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f800/0x9272d942b4a97cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97cca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265572.419304:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f800 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:1.0:1789265572.419307:0:19586:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f800/0x9272d942b4a97cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97cca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265572.419314:0:19586:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f800/0x9272d942b4a97cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a97cca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789265572.419321:0:19586:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f800/0x9272d942b4a97cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a97cca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265572.419326:0:19586:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789265572.419328:0:19586:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789265572.419330:0:19586:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789265572.419336:0:19586:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fccb0e1d000 00010000:00010000:1.0:1789265572.419338:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f800/0x9272d942b4a97cc3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a97cca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265572.419345:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f800/0x9272d942b4a97cc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a97cca expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265572.419352:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265572.419354:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265572.419366:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265572.419495:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789265572.420661:0:21169:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fcb83ced5a0 - data ffff9fcc88c10000/ffff9fcb84be1000 00000020:01000000:2.0:1789265572.420811:0:21169:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fcc887fc960 - data ffff9fcc879c4a20/ffff9fcb838cb000 00100000:10000000:2.0:1789265572.440717:0:21169:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789265572.448479:0:21169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97982 00000020:00000080:3.0:1789265572.448534:0:21169:0:(genops.c:885:class_export_put()) final put ffff9fcca93b1000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789265572.448584:0:21169:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fcc82d4d000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789265572.448589:0:21169:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fcc82d4d000 2 00000020:01000004:3.0:1789265572.448592:0:21169:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fcc82d4d000 from lustre-OST0000 00000020:00000080:3.0:1789265572.448615:0:21169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265572.448623:0:21169:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789265572.448626:0:21169:0:(genops.c:885:class_export_put()) final put ffff9fcca93b0000/lustre-OST0000_UUID 00000020:00000080:3.0:1789265572.448628:0:21169:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcca93b0000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789265572.448635:0:21169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:0.0:1789265572.448694:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcca93b1000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:3.0:1789265572.448797:0:21169:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789265572.448802:0:21169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789265572.448805:0:21169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265572.448810:0:21169:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789265572.448817:0:21169:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9fcc842c2000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789265572.448823:0:21169:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9fccb09b0000) has exports, disconnecting them 00000020:00080000:3.0:1789265572.448828:0:21169:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9fcc842c2000), last request at 1789265492 00000020:00000080:3.0:1789265572.448832:0:21169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a979ac 00000020:00080000:3.0:1789265572.448842:0:21169:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fcc842c2000): rc 0 00000020:00000080:3.0:1789265572.448848:0:21169:0:(genops.c:885:class_export_put()) final put ffff9fcc842c2000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789265572.449732:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc842c2000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789265572.451144:0:21169:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789265572.451150:0:21169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789265572.451194:0:21169:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789265572.451201:0:21169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789265572.451401:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcc85928800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789265572.451523:0:21169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265572.451531:0:21169:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789265572.451536:0:21169:0:(genops.c:885:class_export_put()) final put ffff9fcc842c6000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789265572.451539:0:21169:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc842c6000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789265572.451544:0:21169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1789265572.451604:0:21169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789265572.451611:0:21169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265572.451618:0:21169:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789265572.451626:0:21169:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9fcc8592b800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789265572.451632:0:21169:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9fcc8428cd28) has exports, disconnecting them 00000020:00080000:0.0:1789265572.451636:0:21169:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9fcc8592b800), last request at 1789265492 00000020:00000080:0.0:1789265572.451641:0:21169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a979c1 00000020:00080000:0.0:1789265572.451652:0:21169:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fcc8592b800): rc 0 00000020:00000080:0.0:1789265572.451656:0:21169:0:(genops.c:885:class_export_put()) final put ffff9fcc8592b800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789265572.451718:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc8592b800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1789265572.454155:0:21169:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789265572.454164:0:21169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789265572.454168:0:21169:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789265572.454174:0:21169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789265572.454201:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcc992fc800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789265572.454380:0:21169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265572.454387:0:21169:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1789265572.454392:0:21169:0:(genops.c:885:class_export_put()) final put ffff9fcca93b0800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1789265572.454396:0:21169:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcca93b0800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1789265572.454401:0:21169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1789265572.454468:0:21169:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fcc82d4d000 1 00000020:00000080:1.0:1789265572.454474:0:21169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a9795f 00000020:00000080:1.0:1789265572.454479:0:21169:0:(genops.c:885:class_export_put()) final put ffff9fcc8592b000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789265572.454487:0:21169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789265572.454494:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc8592b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789265572.454503:0:21169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265572.454507:0:21169:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789265572.454511:0:21169:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9fcb829f8000) has no exports 00000020:00000080:1.0:1789265572.483676:0:21169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789265572.483689:0:21169:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789265572.483694:0:21169:0:(genops.c:885:class_export_put()) final put ffff9fcc82d4e000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789265572.483701:0:21169:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc82d4e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789265572.483710:0:21169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789265572.483814:0:21169:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fcc82d49800 00000020:02000400:1.0:1789265572.483866:0:21169:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789265573.377474:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265574.402160:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265575.425283:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265575.489659:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265560/real 1789265560] req@ffff9fcb83c9b800 x1876180417603968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789265575 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265575.489691:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83c9b800 x1876180417603968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789265575 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789265575.489710:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb82af0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265575.489818:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789265575.489823:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876180417603968:0@lo:38:kworker.0 00000100:00080000:2.0:1789265575.490103:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) a57aa04c-0472-45c4-bafc-6983957e249b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789265575.490109:0:14028:0:(pinger.c:247:ptlrpc_pinger_process_import()) a57aa04c-0472-45c4-bafc-6983957e249b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265575.490111:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789265575.490114:0:14028:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789265575.490117:0:14028:0:(import.c:65:import_set_state_nolock()) ffff9fcb82af0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265575.490122:0:14028:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 611 00000100:00080000:2.0:1789265575.490127:0:14028:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789265575.490134:0:14028:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fcb82af0800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265575.490165:0:14028:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83c9aa00 x1876180417604992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265575.490303:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417605120:0@lo:400:kworker.0 00000100:00100000:0.0:1789265575.490347:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876180417604992:0@lo:38:kworker.0 00000400:00000100:3.0:1789265575.490369:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417605120 offset 0 length 224: 4 00000400:00000100:0.0:1789265575.490388:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417604992 offset 0 length 520: 4 00000020:01000004:2.0:1789265575.722442:0:21371:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789265575.734731:0:21371:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789265575.734824:0:21371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fe00/0x9272d942b4a97a31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97a38 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265575.734840:0:21371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fe00/0x9272d942b4a97a31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97a38 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265575.734847:0:21371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fe00/0x9272d942b4a97a31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97a38 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265575.734854:0:21371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fe00/0x9272d942b4a97a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97a38 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265575.734893:0:21371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789265575.734900:0:21371:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789265575.734933:0:21371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789265575.734945:0:21371:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83c9aa00 x1876180417604992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265595 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265575.734969:0:21371:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:3.0:1789265575.734971:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:2.0:1789265575.734977:0:21371:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1789265575.734987:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fe00/0x9272d942b4a97a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97a38 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789265575.734993:0:21371:0:(import.c:65:import_set_state_nolock()) ffff9fcb82af0800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1789265575.734999:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2fe00 already unused, calling callback (ffffffffc1191c20) 00000100:00080000:2.0:1789265575.735001:0:21371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:3.0:1789265575.735006:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fe00/0x9272d942b4a97a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97a38 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265575.735008:0:21371:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83c9aa00 x1876180417604992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789265595 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265575.735048:0:21371:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00010000:00010000:3.0:1789265575.735051:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fe00/0x9272d942b4a97a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a97a38 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265575.735052:0:21371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 10000000:00010000:3.0:1789265575.735063:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fe00/0x9272d942b4a97a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a97a38 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265575.735070:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789265575.735073:0:17180:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789265575.735076:0:17180:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789265575.735091:0:17180:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fccb0e1d000 00010000:00010000:3.0:1789265575.735095:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fe00/0x9272d942b4a97a31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a97a38 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265575.735102:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fe00/0x9272d942b4a97a31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a97a38 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265575.735113:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265575.735115:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265575.735117:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265575.735235:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876180417604992:0@lo:38:kworker.0 00000100:00080000:2.0:1789265575.739757:0:21371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789265575.739775:0:21371:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83c9a300 x1876180417604096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265576 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265575.739865:0:21371:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb84846d80 x1876180417604352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265579 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265575.739886:0:21371:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83c9a680 x1876180417604480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265581 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265575.739911:0:21371:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb84846300 x1876180417604736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265583 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265575.739926:0:21371:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb8495ca80 x1876180417604864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265588 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265575.739932:0:21371:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83c98e00 x1876180417605120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265591 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265575.739957:0:21371:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789265575.739962:0:21371:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789265575.739983:0:21371:0:(import.c:65:import_set_state_nolock()) ffff9fccb6ecd000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789265575.740082:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417604864:0@lo:400:kworker.0 00000100:00100000:0.0:1789265575.740091:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417604352:0@lo:400:kworker.0 00000100:00100000:0.0:1789265575.740134:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1876180417605248:0@lo:39:umount.0 00000400:00000100:0.0:1789265575.740180:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876180417605248 offset 0 length 224: 4 00000100:00100000:1.0:1789265575.740204:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417604736:0@lo:400:kworker.0 00000100:00100000:1.0:1789265575.740215:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417604480:0@lo:400:kworker.0 00000100:00100000:3.0:1789265575.740451:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417604096:0@lo:400:kworker.0 00000100:00100000:3.0:1789265575.740472:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417605120:0@lo:400:kworker.0 00010000:00010000:3.0:1789265576.452487:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265577.476487:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265578.498011:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265579.521810:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789265580.545852:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) a57aa04c-0472-45c4-bafc-6983957e249b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789265580.545862:0:14028:0:(pinger.c:247:ptlrpc_pinger_process_import()) a57aa04c-0472-45c4-bafc-6983957e249b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789265580.550954:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265581.570943:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265582.594411:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265582.913397:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265567/real 1789265567] req@ffff9fcb84844000 x1876180417604608/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789265582 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265582.913438:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb84844000 x1876180417604608/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789265582 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789265582.913456:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccb0e1d000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265582.913483:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789265582.913487:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a57aa04c-0472-45c4-bafc-6983957e249b:3640:1876180417604608:0@lo:250:kworker.0 00000100:00080000:2.0:1789265582.913741:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) a57aa04c-0472-45c4-bafc-6983957e249b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789265582.913746:0:14028:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789265582.913749:0:14028:0:(import.c:65:import_set_state_nolock()) ffff9fccb0e1d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265582.913754:0:14028:0:(import.c:510:import_select_connection()) MGC192.168.203.149@tcp: connect to NID 0@lo last attempt 618 00000100:00080000:2.0:1789265582.913759:0:14028:0:(import.c:589:import_select_connection()) MGC192.168.203.149@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789265582.913766:0:14028:0:(import.c:624:import_select_connection()) MGC192.168.203.149@tcp: import ffff9fccb0e1d000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265582.913798:0:14028:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83c99880 x1876180417605376/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265582.913869:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a57aa04c-0472-45c4-bafc-6983957e249b:3640:1876180417605376:0@lo:250:kworker.0 00000400:00000100:0.0:1789265582.913921:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876180417605376 offset 0 length 520: 4 00010000:00010000:0.0:1789265583.618930:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265584.643630:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265585.665333:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265585.985533:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265575/real 1789265575] req@ffff9fcb83c99500 x1876180417605248/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789265585 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265585.985638:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83c99500 x1876180417605248/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789265585 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789265585.985809:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccb6ecd000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789265585.985832:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1876180417605248:0@lo:39:umount.0 00000100:00080000:1.0:1789265585.985877:0:21371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789265585.985882:0:21371:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789265585.985886:0:21371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789265585.986679:0:21371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5200/0x9272d942b4a97a07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97a0e expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265585.986689:0:21371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5200/0x9272d942b4a97a07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97a0e expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265585.986695:0:21371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5200/0x9272d942b4a97a07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97a0e expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265585.986699:0:21371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5200/0x9272d942b4a97a07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97a0e expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265585.986715:0:21371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265585.986719:0:21371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a97cb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97cbc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265585.986723:0:21371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a97cb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97cbc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265585.986726:0:21371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a97cb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97cbc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265585.986730:0:21371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a97cb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9272d942b4a97cbc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265585.987551:0:21371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789265585.987559:0:21371:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789265585.987602:0:21371:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789265585.987606:0:21371:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789265585.987611:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789265585.987616:0:21371:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789265585.987620:0:21371:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9fccbc5819b8) has no exports 00000020:00080000:1.0:1789265585.987643:0:21371:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9fccbc5819b8) has no exports 00010000:00010000:3.0:1789265585.989849:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265585.989865:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5200/0x9272d942b4a97a07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97a0e expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265585.989971:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5200 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:3.0:1789265585.989977:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5200/0x9272d942b4a97a07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97a0e expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265585.989989:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5200/0x9272d942b4a97a07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a97a0e expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265585.989996:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5200/0x9272d942b4a97a07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a97a0e expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265585.990002:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789265585.990005:0:17180:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789265585.990008:0:17180:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789265585.990038:0:17180:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fccb0e1d000 00010000:00010000:3.0:1789265585.990042:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5200/0x9272d942b4a97a07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a97a0e expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1789265585.990792:0:21371:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fccbc6aaea0 - data ffff9fcc87837af8/ffff9fccbc188c00 00000020:01000000:1.0:1789265585.990916:0:21371:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fcb83cedf00 - data ffff9fcc879b2d80/ffff9fcc842b3400 00010000:00010000:3.0:1789265585.991164:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5200/0x9272d942b4a97a07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a97a0e expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265585.991182:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265585.991200:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a97cb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97cbc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265585.991207:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2ee00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:3.0:1789265585.991211:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a97cb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9272d942b4a97cbc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265585.991220:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a97cb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a97cbc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789265585.991226:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a97cb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a97cbc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265585.991232:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789265585.991234:0:17180:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789265585.991236:0:17180:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789265585.991244:0:17180:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fccb0e1d000 00010000:00010000:3.0:1789265585.991247:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a97cb5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a97cbc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265585.991253:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a97cb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a97cbc expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265585.991275:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265585.991277:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265585.991280:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265585.991498:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789265586.003282:0:21371:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789265586.010510:0:21371:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97a1c 00000020:00000080:0.0:1789265586.010528:0:21371:0:(genops.c:885:class_export_put()) final put ffff9fcc9b26c000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789265586.010552:0:21371:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fccbc124800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789265586.010556:0:21371:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccbc124800 2 00000020:01000004:0.0:1789265586.010559:0:21371:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fccbc124800 from lustre-OST0001 00000020:00000080:0.0:1789265586.010589:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265586.010598:0:21371:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789265586.010602:0:21371:0:(genops.c:885:class_export_put()) final put ffff9fcb82c50000/lustre-OST0001_UUID 00000020:00000080:0.0:1789265586.010605:0:21371:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb82c50000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789265586.010611:0:21371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789265586.010706:0:21371:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a57aa04c-0472-45c4-bafc-6983957e249b->MGS 00010000:00010000:0.0:1789265586.010722:0:21371:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcc81491600/0x9272d942b4a9782b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a97832 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265586.010736:0:21371:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcc81491600/0x9272d942b4a9782b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a97832 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265586.010742:0:21371:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789265586.010745:0:21371:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789265586.010748:0:21371:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789265586.010761:0:21371:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fccb0e1d000 00010000:00010000:0.0:1789265586.010765:0:21371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcc81491600/0x9272d942b4a9782b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a97832 expref: -99 pid: 17925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265586.010779:0:21371:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9272d942b4a97721 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265586.010786:0:21371:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9272d942b4a97721 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265586.010791:0:21371:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789265586.010793:0:21371:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789265586.010795:0:21371:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00000020:00000080:2.0:1789265586.010915:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc9b26c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:0.0:1789265586.011126:0:21371:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fccb0e1d000 00010000:00010000:0.0:1789265586.011130:0:21371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9771a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9272d942b4a97721 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789265586.011150:0:21371:0:(import.c:65:import_set_state_nolock()) ffff9fccb0e1d000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789265586.011154:0:21371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789265586.011156:0:21371:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789265586.011157:0:21371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789265586.011161:0:21371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789265586.011170:0:21371:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fcb83c99880 x1876180417605376/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789265602 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789265586.011190:0:21371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789265586.011192:0:21371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:2.0:1789265586.011250:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a57aa04c-0472-45c4-bafc-6983957e249b:3640:1876180417605376:0@lo:250:kworker.0 10000000:01000000:0.0:1789265586.011469:0:21371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789265586.011476:0:21371:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97705 00000020:00000080:0.0:1789265586.011481:0:21371:0:(genops.c:885:class_export_put()) final put ffff9fcb84945000/a57aa04c-0472-45c4-bafc-6983957e249b 00000020:01000000:0.0:1789265586.011487:0:21371:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.149@tcp (flags='') 00000020:00000080:0.0:1789265586.011492:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265586.011496:0:21371:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.149@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789265586.011499:0:21371:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9fcb829f99b8) has no exports 00000020:00000080:2.0:1789265586.011548:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb84945000/a57aa04c-0472-45c4-bafc-6983957e249b for MGC192.168.203.149@tcp 10000000:01000000:2.0:1789265586.011575:0:17189:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789265586.012125:0:21371:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.149@tcp: client import never connected 00000100:00080000:0.0:1789265586.012129:0:21371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789265586.012131:0:21371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789265586.012133:0:21371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789265586.012135:0:21371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789265586.012176:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789265586.012181:0:21371:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.149@tcp (uuid a57aa04c-0472-45c4-bafc-6983957e249b) 00000020:01000000:0.0:1789265586.012187:0:21371:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789265586.012190:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789265586.012194:0:21371:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789265586.012198:0:21371:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9fcb82af1000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789265586.012203:0:21371:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9fccbc584d28) has exports, disconnecting them 00000020:00080000:0.0:1789265586.012215:0:21371:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9fcb82af1000), last request at 1789265507 00000020:00000080:0.0:1789265586.012219:0:21371:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97a46 00000020:00080000:0.0:1789265586.012230:0:21371:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fcb82af1000): rc 0 00000020:00000080:0.0:1789265586.012234:0:21371:0:(genops.c:885:class_export_put()) final put ffff9fcb82af1000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789265586.013050:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccb0e1d000 for MGC192.168.203.149@tcp 00000020:00000080:2.0:1789265586.013059:0:14028:0:(genops.c:885:class_export_put()) final put ffff9fccb0e1a800/a57aa04c-0472-45c4-bafc-6983957e249b 00000020:00000080:2.0:1789265586.013068:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccb0e1a800/a57aa04c-0472-45c4-bafc-6983957e249b for MGC192.168.203.149@tcp 00000020:01000000:2.0:1789265586.013074:0:14028:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.149@tcp (a57aa04c-0472-45c4-bafc-6983957e249b) 00000020:00000080:2.0:1789265586.013338:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb82af1000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789265586.014596:0:21371:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789265586.014604:0:21371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789265586.014608:0:21371:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789265586.014614:0:21371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789265586.014779:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265586.014794:0:21371:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789265586.015096:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fcb82af0800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789265586.015146:0:21371:0:(genops.c:885:class_export_put()) final put ffff9fcb82af4800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789265586.015149:0:21371:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcb82af4800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789265586.015160:0:21371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1789265586.015220:0:21371:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789265586.015224:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265586.015229:0:21371:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789265586.015236:0:21371:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9fccb6ec8000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789265586.015241:0:21371:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9fccb09b4d28) has exports, disconnecting them 00000020:00080000:3.0:1789265586.015246:0:21371:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9fccb6ec8000), last request at 1789265507 00000020:00000080:3.0:1789265586.015250:0:21371:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97a5b 00000020:00080000:3.0:1789265586.015260:0:21371:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fccb6ec8000): rc 0 00000020:00000080:3.0:1789265586.015277:0:21371:0:(genops.c:885:class_export_put()) final put ffff9fccb6ec8000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1789265586.016405:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccb6ec8000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1789265586.021445:0:21371:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789265586.021454:0:21371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789265586.021459:0:21371:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789265586.021467:0:21371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789265586.021500:0:14028:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fccb6ecd000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1789265586.073696:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1789265586.075779:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789265586.081170:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1789265586.081977:0:17175:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9fccacd8cc00:17175] 0 exiting: rc = 1 00000100:00100000:3.0:1789265586.085640:0:17176:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9fccacd8c000:17176] 1 exiting: rc = 0 00000100:00100000:2.0:1789265586.086018:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.086461:0:20967:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9fcc854ed800:20967] 3 exiting: rc = 0 00000100:00100000:2.0:1789265586.087357:0:17179:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9fccbd26be00:17179] 2 exiting: rc = 0 00000100:00100000:0.0:1789265586.087994:0:17177:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9fccbd26a800:17177] 0 exiting: rc = 1 00000100:00100000:0.0:1789265586.088072:0:17178:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9fccbd26ba00:17178] 1 exiting: rc = 0 00000100:00100000:2.0:1789265586.088321:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088330:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088336:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088342:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088349:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088354:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088360:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088365:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088370:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088375:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088380:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088385:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088390:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088395:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088400:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088459:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088470:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088474:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088491:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088496:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088501:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088506:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088512:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088527:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088533:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088538:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088662:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088671:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088676:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088681:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088687:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088780:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088788:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088793:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088802:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088807:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088812:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088818:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088823:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088828:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088833:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088838:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088843:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088848:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088854:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088860:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088865:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088870:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088875:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088880:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088885:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088890:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088895:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088908:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088912:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088917:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088922:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088927:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088937:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088943:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088948:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088954:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088959:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.088964:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789265586.093224:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789265586.093243:0:21371:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1789265586.093250:0:21371:0:(genops.c:885:class_export_put()) final put ffff9fccb6ec8800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1789265586.093254:0:21371:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccb6ec8800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1789265586.093270:0:21371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1789265586.093327:0:21371:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccbc124800 1 00000020:00000080:2.0:1789265586.093334:0:21371:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9272d942b4a97a00 00000020:00000080:2.0:1789265586.093339:0:21371:0:(genops.c:885:class_export_put()) final put ffff9fccbca76800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789265586.093352:0:21371:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789265586.093363:0:14028:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbca76800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789265586.094196:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789265586.094203:0:21371:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789265586.094322:0:21371:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9fcc84288000) has no exports 00000020:00000080:3.0:1789265586.164170:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265586.164184:0:21371:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789265586.164190:0:21371:0:(genops.c:885:class_export_put()) final put ffff9fccbc127000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789265586.164195:0:21371:0:(genops.c:844:class_export_destroy()) destroying export ffff9fccbc127000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789265586.164204:0:21371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789265586.165050:0:21371:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fccbc126000 00000020:01000000:3.0:1789265586.165085:0:21371:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789265586.165090:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789265586.165094:0:21371:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789265586.165098:0:21371:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9fccbd378000) has no exports 00000020:00000080:3.0:1789265586.165125:0:21371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789265586.165132:0:21371:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789265586.165136:0:21371:0:(genops.c:885:class_export_put()) final put ffff9fcc85929000/OSS_uuid 00000020:00000080:3.0:1789265586.165139:0:21371:0:(genops.c:844:class_export_destroy()) destroying export ffff9fcc85929000/OSS_uuid for OSS 00000020:01000000:3.0:1789265586.165158:0:21371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1789265586.165222:0:17188:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789265586.167248:0:18701:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9fccb7392c00:18701] 1 exiting: rc = 0 00000100:00100000:0.0:1789265586.167550:0:18702:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9fcc91528e00:18702] 2 exiting: rc = 0 00000100:00100000:1.0:1789265586.167941:0:19247:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9fcb83943800:19247] 3 exiting: rc = 0 00000100:00100000:3.0:1789265586.167955:0:18700:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9fcb829c5a00:18700] 0 exiting: rc = 1 00000100:00100000:3.0:1789265586.168677:0:19582:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9fcb82ae6400:19582] 4 exiting: rc = 0 00000100:00100000:2.0:1789265586.168999:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169008:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169014:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169019:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169054:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169059:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169064:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169079:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169084:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169088:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169093:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169098:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169103:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169107:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169111:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169116:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169120:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169125:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169130:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169135:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169140:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169145:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169151:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169156:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169160:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169165:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169169:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169175:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169179:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169184:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169190:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169195:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169200:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169205:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169210:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169215:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169220:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169225:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169230:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169235:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169240:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169245:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169258:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169273:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169279:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169283:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169287:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169292:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169296:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169301:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169305:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169309:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169313:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169318:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169322:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169328:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169332:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169337:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169342:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169347:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169353:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169358:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169363:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.169368:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.171016:0:18703:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9fcc84270000:18703] 0 exiting: rc = 1 00000100:00100000:0.0:1789265586.175604:0:18704:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9fcc84271600:18704] 1 exiting: rc = 0 00000100:00100000:2.0:1789265586.175742:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175749:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175754:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175759:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175765:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175769:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175794:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175800:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175815:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175822:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175827:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175831:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175849:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175854:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175859:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175863:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175868:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175873:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175878:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175883:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175888:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175893:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175898:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175903:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175908:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175912:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175916:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175921:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175925:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175929:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175934:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175938:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175943:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175948:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175954:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175960:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175965:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175970:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175975:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175981:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175986:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175991:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.175996:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176001:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176006:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176012:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176017:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176051:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176066:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176074:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176079:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176083:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176088:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176093:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176098:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176102:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176108:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176112:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176117:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176121:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176126:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176131:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176136:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.176142:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.178344:0:20335:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9fcb82186c00:20335] 3 exiting: rc = 0 00000100:00100000:3.0:1789265586.178483:0:18706:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9fcc843d3800:18706] 1 exiting: rc = 0 00000100:00100000:1.0:1789265586.178649:0:18705:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9fcc843d3e00:18705] 0 exiting: rc = 1 00000100:00100000:1.0:1789265586.179188:0:18707:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9fcc843d2600:18707] 2 exiting: rc = 0 00000100:00100000:2.0:1789265586.179584:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.179592:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.179598:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.179603:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.179608:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.179614:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.179619:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.179641:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.179648:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.179653:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.179658:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.179664:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.179670:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.179998:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180009:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180015:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180020:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180042:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180060:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180066:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180071:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180076:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180082:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180087:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180093:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180098:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180103:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180109:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180115:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180120:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180125:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180145:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180153:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180158:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180164:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180170:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180177:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180182:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180188:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180195:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180201:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180207:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180212:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180217:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180223:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180231:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180239:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180254:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180272:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180278:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180283:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180298:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180305:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180317:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180322:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180337:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180344:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180349:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180354:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180360:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180366:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180371:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180376:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789265586.180383:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.191126:0:18708:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9fcc843d2800:18708] 0 exiting: rc = 1 00000100:00100000:3.0:1789265586.192478:0:18709:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9fcc842cb000:18709] 1 exiting: rc = 0 00000100:00100000:3.0:1789265586.199762:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199772:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199777:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199782:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199787:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199792:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199797:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199802:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199807:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199812:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199817:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199821:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199826:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199832:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199837:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199842:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199847:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199852:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199856:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199861:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199866:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199871:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199877:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199882:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199887:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199892:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199896:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199902:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199907:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199927:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199932:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199937:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199942:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199946:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199951:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199956:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199961:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199965:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199971:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199976:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199981:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199986:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199992:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.199997:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200003:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200009:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200014:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200019:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200111:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200122:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200133:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200144:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200155:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200166:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200175:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200185:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200195:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200203:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200208:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200214:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200221:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200227:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200233:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789265586.200242:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.204560:0:18711:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9fcc85bb9800:18711] 1 exiting: rc = 0 00000100:00100000:2.0:1789265586.205383:0:18710:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9fcc85bb4c00:18710] 0 exiting: rc = 1 00000100:00100000:1.0:1789265586.205521:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.205529:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.205551:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.205559:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.205848:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.205929:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.205939:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.205966:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.205975:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.205981:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.205988:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.205995:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206002:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206007:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206014:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206020:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206046:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206066:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206072:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206091:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206098:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206106:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206113:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206119:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206125:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206131:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206138:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206146:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206153:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206158:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206164:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206183:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206192:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206197:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206202:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206208:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206214:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206220:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206224:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206229:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206235:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206242:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.206249:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207240:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207256:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207273:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207283:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207289:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207294:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207300:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207305:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207311:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207327:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207335:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207341:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207438:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207449:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207457:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207468:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207536:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207553:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207560:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207672:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789265586.207679:0:21371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789265586.229678:0:21371:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789265603.658327:0:22137:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789265613.521327:0:22738:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789265613.521334:0:22738:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789265613.521335:0:22738:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789265613.521441:0:22738:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fccbc1ce800 00000020:01000004:3.0:1789265613.521455:0:22738:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789265613.521463:0:22738:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789265613.521477:0:22738:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9fccb09b19b8) 00000020:00000080:3.0:1789265613.521490:0:22738:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789265613.592725:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789265613.604389:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789265613.608463:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1789265613.609841:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789265613.611108:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789265613.612829:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789265613.613340:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1789265613.613847:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789265613.614323:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1789265613.614668:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1789265613.615309:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1789265613.616230:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1789265613.616605:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789265613.616900:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789265613.617122:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789265613.618298:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789265613.618739:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1789265613.620471:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1789265613.620852:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1789265613.621127:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789265613.621632:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1789265613.621877:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789265613.622343:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789265613.622725:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1789265613.623317:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1789265613.623739:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789265613.624325:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789265613.624610:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1789265613.625297:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789265613.625607:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789265613.626291:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789265613.626485:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789265613.626749:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789265613.626929:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1789265613.627638:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789265613.627893:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789265613.628332:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789265613.628725:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789265613.629464:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789265613.630425:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1789265613.630746:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789265613.631212:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789265613.631733:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1789265613.632369:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1789265613.632677:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789265613.636746:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789265613.640541:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789265613.642012:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789265613.642321:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789265613.642510:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789265613.642930:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1789265613.643103:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1789265613.643613:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1789265613.644709:0:22738:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789265613.644911:0:22738:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789265613.644920:0:22738:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789265613.644930:0:22738:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a97f71 00000020:01000004:2.0:1789265613.644936:0:22738:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789265613.644941:0:22738:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789265613.644946:0:22738:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fccbc1ce800 from MGS 00000020:01000004:2.0:1789265613.644949:0:22738:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789265613.644966:0:22738:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9fcc84288000) 00000020:00000080:2.0:1789265613.644977:0:22738:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789265613.645062:0:22738:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fccbc1ce800 from MGS, refs=2 00080000:01000000:2.0:1789265613.645068:0:22738:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789265613.645073:0:22738:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a97f7f 00000100:00100000:2.0:1789265613.645185:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789265613.645312:0:22738:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789265613.645318:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789265613.646227:0:22738:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789265613.646235:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789265613.648914:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265613.649510:0:22738:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789265613.649519:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789265613.650828:0:22738:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789265613.650838:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789265613.652115:0:22738:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789265613.652124:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789265613.652690:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265613.652695:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265613.652697:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265613.653191:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265613.653194:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265613.653196:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265613.653647:0:22738:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789265613.658509:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789265613.666264:0:22738:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789265613.671738:0:22750:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789265613.677209:0:22738:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789265613.677262:0:22738:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789265613.677826:0:22738:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789265613.678216:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265613.678384:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789265613.678391:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789265613.678998:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789265613.679005:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789265613.679373:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789265613.679379:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789265613.680071:0:22738:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789265613.680104:0:22738:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.149@tcp' 00000020:01000004:3.0:1789265613.680106:0:22738:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789265613.680136:0:22738:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.149@tcp (typ=mgc) 00000020:00000080:3.0:1789265613.680149:0:22738:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.149@tcp (ffff9fccb09b3370) 00000020:00000080:3.0:1789265613.680163:0:22738:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789265613.680238:0:22738:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fccaa067800@MGC192.168.203.149@tcp: add connection 192.168.203.149@tcp at head 00010000:00010000:3.0:1789265613.680375:0:22738:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.149@tcp-0 is initialized 00000040:01000000:3.0:1789265613.680381:0:22738:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.149@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789265613.686390:0:22755:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789265613.690700:0:22757:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789265613.690970:0:22738:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.149@tcp (uuid 82fe313a-a4f8-4781-be1f-82c20160e337) 00000020:00000080:1.0:1789265613.690998:0:22738:0:(genops.c:1385:class_connect()) connect: client 82fe313a-a4f8-4781-be1f-82c20160e337, cookie 0x9272d942b4a97f8d 00000100:00080000:1.0:1789265613.691012:0:22738:0:(import.c:510:import_select_connection()) MGC192.168.203.149@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789265613.691018:0:22738:0:(import.c:624:import_select_connection()) MGC192.168.203.149@tcp: import ffff9fccaa067800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265613.691175:0:22738:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb84846300 x1876180417605504/t0(0) o250->MGC192.168.203.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265613.691267:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:82fe313a-a4f8-4781-be1f-82c20160e337:3640:1876180417605504:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789265613.691338:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789265613.691407:0:22738:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 82fe313a-a4f8-4781-be1f-82c20160e337->MGS 00000020:01000004:1.0:1789265613.691426:0:22738:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789265613.691431:0:22738:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789265613.691444:0:22738:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9fccbc580000) 00000020:00000080:1.0:1789265613.691457:0:22738:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789265613.691712:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417605504 00000100:00100000:3.0:1789265613.691720:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417605504 00000100:00100000:3.0:1789265613.691750:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265613.691758:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc85816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1876180417605504:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789265613.691779:0:22752:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 82fe313a-a4f8-4781-be1f-82c20160e337@0@lo t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:3.0:1789265613.691801:0:22752:0:(genops.c:1385:class_connect()) connect: client 82fe313a-a4f8-4781-be1f-82c20160e337, cookie 0x9272d942b4a97f9b 00000100:00080000:3.0:1789265613.691934:0:22752:0:(import.c:65:import_set_state_nolock()) ffff9fccaa066800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265613.702240:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc85816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+5:3640:x1876180417605504:12345-0@lo:250:mount.lustre.0 Request processed in 10471us (10891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265613.702260:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265613.702407:0:3640:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.149@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789265613.702419:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.149@tcp: connect to target with instance 0 00000100:00080000:0.0:1789265613.702428:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.149@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789265613.702433:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789265613.702437:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccaa067800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789265613.702440:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789265613.702457:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789265613.702464:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:82fe313a-a4f8-4781-be1f-82c20160e337:3640:1876180417605504:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789265613.709428:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265613.709700:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789265613.709707:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789265613.711410:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789265613.711420:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789265613.712393:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789265613.712402:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789265613.714956:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265613.715188:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789265613.715200:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789265613.716607:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789265613.716616:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789265613.751616:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265613.751829:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789265613.751843:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789265613.754911:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789265613.754926:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789265613.755897:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265613.756127:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265613.756132:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789265613.761325:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789265613.761339:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789265613.762170:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265613.762349:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265613.762354:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789265613.766984:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789265613.766998:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789265613.767904:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265613.768237:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789265613.768243:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789265613.768738:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789265613.768745:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789265613.800726:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265613.803193:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789265613.803205:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789265613.806285:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789265613.806297:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789265613.807315:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789265613.807326:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789265613.812109:0:22738:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789265613.812810:0:22738:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789265613.812817:0:22738:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.149@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789265613.812919:0:22738:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.149@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789265613.812954:0:22738:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.149@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789265613.812959:0:22738:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789265613.812961:0:22738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789265613.812962:0:22738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265613.812963:0:22738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265613.812965:0:22738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265613.812966:0:22738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265613.812967:0:22738:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265613.812969:0:22738:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789265613.812971:0:22738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265613.812972:0:22738:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789265613.812975:0:22738:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789265613.812977:0:22738:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789265613.812983:0:22738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789265613.812985:0:22738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265613.812985:0:22738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265613.812986:0:22738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265613.812987:0:22738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265613.812988:0:22738:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265613.812989:0:22738:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789265613.812990:0:22738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265613.812990:0:22738:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789265613.813016:0:22738:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789265613.813087:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417605632:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789265613.813172:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265613.813204:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd251780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265613.813328:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417605632 00000100:00100000:1.0:1789265613.813336:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417605632 00000100:00100000:1.0:1789265613.813380:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265613.813389:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc87ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+5:22738:x1876180417605632:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789265613.813444:0:22754:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789265613.813447:0:22754:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789265613.813450:0:22754:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789265613.813967:0:22775:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789265613.814891:0:22754:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1789265613.816272:0:22776:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789265613.816278:0:22776:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1789265613.816281:0:22776:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789265613.816283:0:22776:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789265613.816502:0:22776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1789265613.817987:0:22754:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789265613.817998:0:22754:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789265613.828420:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc87ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+5:22738:x1876180417605632:12345-0@lo:253:mount.lustre.0 Request processed in 15024us (15240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265613.828439:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265613.828554:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417605632:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789265613.828570:0:22738:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789265613.828573:0:22738:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265613.828575:0:22738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789265613.828577:0:22738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265613.828578:0:22738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265613.828579:0:22738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265613.828581:0:22738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265613.828583:0:22738:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789265613.828584:0:22738:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789265613.828586:0:22738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265613.828587:0:22738:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789265613.828611:0:22738:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fccbc1ce800 from lustre-MDT0000 10000000:01000000:1.0:1789265613.828646:0:22738:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789265613.828649:0:22738:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789265613.828653:0:22738:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fccb09b3370 10000000:01000000:1.0:1789265613.828657:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265613.828680:0:22738:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fccb09b3370 from 1 10000000:01000000:1.0:1789265613.828683:0:22738:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789265613.828717:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a97fa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.828727:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a97fa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.828737:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a97fa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265613.828756:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417605760:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265613.828793:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265613.829242:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdb66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265613.829363:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417605760 00000100:00100000:3.0:1789265613.829371:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417605760 00000100:00100000:3.0:1789265613.829449:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265613.829458:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+5:22738:x1876180417605760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265613.829470:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265613.829486:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f53c00/0x9272d942b4a97fa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97fa2 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265613.829509:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f53c00/0x9272d942b4a97fa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97fa2 expref: 6 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265613.829520:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f53c00/0x9272d942b4a97fa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97fa2 expref: 6 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265613.829530:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f53c00, rc 0) 00000100:00100000:3.0:1789265613.829581:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+6:22738:x1876180417605760:12345-0@lo:101:mount.lustre.0 Request processed in 125us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265613.829587:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789265613.829656:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417605760:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265613.829670:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a97fa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fa9 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.829679:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a97fa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97fa9 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265613.829730:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417605888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265613.829756:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265613.829777:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdb66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265613.829796:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417605888 00000100:00100000:0.0:1789265613.829800:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417605888 00000100:00100000:0.0:1789265613.829863:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265613.829871:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+6:22738:x1876180417605888:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265613.829945:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+6:22738:x1876180417605888:12345-0@lo:501:mount.lustre.0 Request processed in 75us (188us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789265613.829952:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265613.830131:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417605888:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789265613.830225:0:22738:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789265613.830285:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a97fa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fa9 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.830314:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a97fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fa9 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265613.830323:0:22738:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fccbc1ce800 10000000:01000000:1.0:1789265613.830327:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789265613.830331:0:22738:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fccbc1ce800 10000000:01000000:1.0:1789265613.830334:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789265613.830338:0:22738:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fccbc1ce800 from 1 10000000:01000000:1.0:1789265613.830340:0:22738:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789265613.830361:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe600/0x9272d942b4a97fb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.830368:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe600/0x9272d942b4a97fb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.830376:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe600/0x9272d942b4a97fb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265613.830792:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417606016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265613.830829:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265613.830864:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdb66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265613.831109:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417606016 00000100:00100000:3.0:1789265613.831116:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417606016 00000100:00100000:3.0:1789265613.831154:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265613.831162:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+6:22738:x1876180417606016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265613.831173:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265613.831186:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f52e00/0x9272d942b4a97fb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97fb0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265613.831691:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f52e00/0x9272d942b4a97fb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97fb0 expref: 7 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265613.831706:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f52e00/0x9272d942b4a97fb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97fb0 expref: 7 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265613.831715:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f52e00, rc 0) 00000100:00100000:3.0:1789265613.831773:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+7:22738:x1876180417606016:12345-0@lo:101:mount.lustre.0 Request processed in 611us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265613.831780:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265613.831941:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417606016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265613.831956:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe600/0x9272d942b4a97fb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fb7 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.831964:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe600/0x9272d942b4a97fb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97fb7 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265613.831994:0:22738:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789265613.832010:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe600/0x9272d942b4a97fb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fb7 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.832017:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe600/0x9272d942b4a97fb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fb7 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265613.832057:0:22738:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789265613.832062:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265613.832069:0:22738:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fccbc1ce800 10000000:01000000:1.0:1789265613.832072:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789265613.832087:0:22738:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789265613.832090:0:22738:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789265613.832110:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97fbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.832117:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97fbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.832125:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97fbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265613.832140:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417606144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265613.832170:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265613.832203:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdb66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265613.833152:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417606144 00000100:00100000:0.0:1789265613.833168:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417606144 00000100:00100000:0.0:1789265613.833214:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265613.833295:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+7:22738:x1876180417606144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265613.833308:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265613.833326:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83da4c00/0x9272d942b4a97fc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a97fbe expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.833360:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83da4c00/0x9272d942b4a97fc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a97fbe expref: 8 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.833371:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83da4c00/0x9272d942b4a97fc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a97fbe expref: 8 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.833379:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4c00, rc 0) 00000100:00100000:0.0:1789265613.833426:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+8:22738:x1876180417606144:12345-0@lo:101:mount.lustre.0 Request processed in 135us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265613.833432:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789265613.833514:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417606144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265613.833529:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97fbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fc5 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.833555:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97fbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a97fc5 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265613.833853:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417606272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265613.833883:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265613.834396:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdb66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265613.835609:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417606272 00000100:00100000:3.0:1789265613.835619:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417606272 00000100:00100000:3.0:1789265613.835789:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265613.835799:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+8:22738:x1876180417606272:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265613.836151:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417606272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265613.836165:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+9:22738:x1876180417606272:12345-0@lo:501:mount.lustre.0 Request processed in 190us (2103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265613.836177:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265613.836230:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417606400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265613.836279:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265613.836321:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdb66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265613.836430:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417606400 00000100:00100000:3.0:1789265613.836435:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417606400 00000100:00100000:3.0:1789265613.836468:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789265613.836475:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+9:22738:x1876180417606400:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265613.838426:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+9:22738:x1876180417606400:12345-0@lo:503:mount.lustre.0 Request processed in 1743us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265613.838441:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265613.839843:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417606400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265613.840510:0:22777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82fe313a-a4f8-4781-be1f-82c20160e337:22777:1876180417606528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789265613.840580:0:22777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265613.840672:0:22777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b29cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265613.840760:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417606528 00000100:00100000:1.0:1789265613.840766:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417606528 00000100:00100000:1.0:1789265613.840846:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265613.840856:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+9:22777:x1876180417606528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265613.841867:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+9:22777:x1876180417606528:12345-0@lo:502:llog_process_th.0 Request processed in 1009us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265613.841878:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265613.841912:0:22777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82fe313a-a4f8-4781-be1f-82c20160e337:22777:1876180417606528:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265613.841941:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265613.841952:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265613.841954:0:22777:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789265613.841959:0:22777:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789265613.841963:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265613.841976:0:22777:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9fccb09b4d28) 00000020:00000080:3.0:1789265613.841992:0:22777:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789265613.841998:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789265613.842197:0:22777:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789265613.842207:0:22777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a97fd3 00000020:00000080:2.0:1789265613.842417:0:22777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789265613.842423:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265613.842428:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265613.842429:0:22777:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789265613.842432:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265613.842436:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265613.842437:0:22777:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789265613.842441:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265613.842450:0:22777:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9fcc8428cd28) 00000020:00000080:2.0:1789265613.842462:0:22777:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789265613.842467:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789265613.842470:0:22777:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789265613.842473:0:22777:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789265613.842487:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789265613.842545:0:22777:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fccbc1ce800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789265613.842559:0:22777:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9fcc842899b8) 00000020:00000080:2.0:1789265613.842569:0:22777:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789265613.842622:0:22777:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789265613.842628:0:22777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a97fe8 00000020:00000080:2.0:1789265613.842728:0:22777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789265613.842734:0:22777:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789265613.842738:0:22777:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9272d942b4a97fef 00080000:01000000:2.0:1789265613.842743:0:22777:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789265613.842746:0:22777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a97ff6 00010000:00010000:3.0:1789265613.925677:0:22777:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789265613.926374:0:22777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:3.0:1789265613.926826:0:22777:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789265613.927315:0:22777:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9fccb09b0000) 00000020:00000080:3.0:1789265613.927437:0:22777:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789265613.927514:0:22777:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789265613.927523:0:22777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a98004 00000020:00000080:3.0:1789265613.929036:0:22777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789265613.935481:0:22777:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9272d942b4a9800b 00000020:00000080:2.0:1789265613.937536:0:22777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789265613.937549:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265613.937556:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265613.937558:0:22777:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789265613.937561:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789265613.937564:0:22777:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1789265613.937565:0:22777:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789265613.937567:0:22777:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789265613.937568:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789265613.937570:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265613.937571:0:22777:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789265613.937574:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265613.937578:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265613.937579:0:22777:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789265613.937584:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789265613.937629:0:22777:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789265613.937643:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265613.937646:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265613.937648:0:22777:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789265613.937650:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265613.937654:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265613.937655:0:22777:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789265613.937658:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789265613.937671:0:22777:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000020:00000080:2.0:1789265613.937699:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265613.937715:0:22777:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9fcc8428b370) 00000020:00000080:2.0:1789265613.937731:0:22777:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789265613.937735:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789265613.937790:0:22777:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789265613.937795:0:22777:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789265613.937803:0:22777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a98019 00010000:00080000:2.0:1789265613.937841:0:22777:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcb83e09000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.149@tcp at head 00010000:00010000:2.0:1789265613.944308:0:22777:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1789265613.945122:0:22777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789265613.945135:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789265613.945180:0:22777:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789265613.945199:0:22777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a98020 00000100:00080000:2.0:1789265613.945209:0:22777:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265613.945214:0:22777:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fcb83e09000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265613.945468:0:22777:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83c99880 x1876180417606656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265613.945492:0:22777:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1789265613.945539:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265613.945543:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265613.945545:0:22777:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789265613.945548:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789265613.945550:0:22777:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1789265613.945552:0:22777:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789265613.945553:0:22777:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789265613.945555:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789265613.945557:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265613.945558:0:22777:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789265613.945560:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789265613.945564:0:22777:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789265613.945573:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265613.945575:0:22777:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789265613.945578:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789265613.945581:0:22777:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000020:01000000:2.0:1789265613.945605:0:22777:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789265613.945607:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789265613.945619:0:22777:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fcb829f99b8) 00000020:00000080:2.0:1789265613.945629:0:22777:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789265613.945633:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789265613.945684:0:22777:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789265613.945690:0:22777:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789265613.945696:0:22777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a9802e 00010000:00080000:2.0:1789265613.945721:0:22777:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcc82d4e000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.149@tcp at head 00010000:00010000:2.0:1789265613.945893:0:22777:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1789265613.946386:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417606656:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789265613.946457:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265613.946965:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417606656 00000100:00100000:2.0:1789265613.946972:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417606656 00000100:00100000:2.0:1789265613.947004:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265613.947012:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1876180417606656:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1789265613.947049:0:22764:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1789265613.958815:0:22777:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789265613.959090:0:22777:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789265613.965280:0:22777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265613.967583:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1876180417606656:12345-0@lo:38:llog_process_th.0 Request processed in 20565us (21120us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789265613.967602:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789265613.967682:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb83e09000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265613.967688:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789265613.967692:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417606656:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789265613.968722:0:22777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1789265613.972469:0:22777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1789265613.972917:0:22783:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789265613.972922:0:22783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789265613.974218:0:22777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789265613.974231:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789265613.974268:0:22777:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789265613.974290:0:22777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a98035 00000100:00080000:0.0:1789265613.974301:0:22777:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265613.974307:0:22777:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fcc82d4e000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265613.974443:0:22777:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83d44a80 x1876180417606784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789265613.974518:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417606784:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789265613.974590:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417606784 offset 0 length 520: 4 00000100:00080000:0.0:1789265613.974714:0:22777:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789265613.974791:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265613.974796:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265613.974799:0:22777:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789265613.974802:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789265613.974809:0:22777:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1789265613.974811:0:22777:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789265613.974813:0:22777:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789265613.974815:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789265613.974818:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265613.974819:0:22777:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789265613.974822:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789265613.974825:0:22777:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789265613.974829:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265613.974830:0:22777:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789265613.974833:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789265613.974836:0:22777:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000020:01000000:0.0:1789265613.974857:0:22777:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789265613.974860:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789265613.974873:0:22777:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fcc837ecd28) 00000020:00000080:0.0:1789265613.974885:0:22777:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1789265613.974890:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789265613.974951:0:22777:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789265613.974957:0:22777:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789265613.974963:0:22777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9272d942b4a98043 00010000:00080000:0.0:1789265613.974992:0:22777:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fccb4fdb800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.149@tcp at head 00010000:00010000:0.0:1789265613.975230:0:22777:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789265613.975297:0:22777:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789265613.975312:0:22777:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789265613.976945:0:22777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265613.977593:0:22777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1789265613.977780:0:22777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1789265613.979188:0:22785:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789265613.979195:0:22785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789265613.980141:0:22777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789265613.980154:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789265613.980189:0:22777:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789265613.980209:0:22777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a9804a 00000100:00080000:2.0:1789265613.980219:0:22777:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265613.980224:0:22777:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fccb4fdb800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265613.980260:0:22777:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83c99500 x1876180417606912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265613.980294:0:22777:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789265613.980355:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265613.980359:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265613.980361:0:22777:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789265613.980364:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265613.980367:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265613.980369:0:22777:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265613.980372:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265613.980374:0:22777:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789265613.980376:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265613.980378:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265613.980379:0:22777:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789265613.980382:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265613.980384:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265613.980385:0:22777:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789265613.980389:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789265613.980420:0:22777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82fe313a-a4f8-4781-be1f-82c20160e337:22777:1876180417607040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265613.980497:0:22777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265613.980539:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417607040 00000100:00100000:2.0:1789265613.980546:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417607040 00000100:00100000:2.0:1789265613.980584:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789265613.980593:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+9:22777:x1876180417607040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265613.980898:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417606912:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789265613.980929:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417606912 offset 0 length 520: 4 00000100:00100000:3.0:1789265613.981146:0:22777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3b3900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265613.981377:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+9:22777:x1876180417607040:12345-0@lo:502:llog_process_th.0 Request processed in 784us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265613.981387:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265613.982270:0:22777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82fe313a-a4f8-4781-be1f-82c20160e337:22777:1876180417607040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789265613.982311:0:22777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265613.982318:0:22777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265613.982321:0:22777:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789265613.982334:0:22777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789265613.982530:0:22738:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789265613.982551:0:22738:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789265613.982606:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97fbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fc5 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.982626:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe400/0x9272d942b4a97fbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fc5 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265613.982634:0:22738:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fccbc1ce800 from 1 10000000:01000000:1.0:1789265613.982637:0:22738:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789265613.982677:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a98051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.982684:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a98051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.982693:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a98051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265613.982712:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417607168:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265613.982755:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265613.982795:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265613.983091:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417607168 00000100:00100000:2.0:1789265613.983097:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417607168 00000100:00100000:2.0:1789265613.983139:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265613.983148:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+9:22738:x1876180417607168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265613.983167:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265613.983182:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a98058 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a98051 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265613.983205:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a98058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a98051 expref: 10 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265613.983216:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a98058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a98051 expref: 10 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265613.983225:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2f200, rc 0) 00000100:00100000:2.0:1789265613.983263:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+10:22738:x1876180417607168:12345-0@lo:101:mount.lustre.0 Request processed in 117us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265613.983270:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265613.983398:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417607168:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265613.983411:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a98051 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98058 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.983425:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a98051 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a98058 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265613.984111:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417607296:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789265613.984156:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265613.984846:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265613.984922:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417607296 00000100:00100000:2.0:1789265613.984928:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417607296 00000100:00100000:2.0:1789265613.984975:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265613.984984:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+10:22738:x1876180417607296:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789265613.985001:0:22753:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789265613.985007:0:22753:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789265613.985138:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+10:22738:x1876180417607296:12345-0@lo:256:mount.lustre.0 Request processed in 155us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265613.985146:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265613.985241:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417607296:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789265613.985864:0:22738:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265613.987959:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a98051 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98058 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.988057:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a98051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98058 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265613.988066:0:22738:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccbc1ce800 from 1 10000000:01000000:0.0:1789265613.988069:0:22738:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265613.988118:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a9805f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.988126:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a9805f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.988136:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a9805f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265613.988160:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417607424:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789265613.988233:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265613.988272:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd251c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265613.988356:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417607424 00000100:00100000:1.0:1789265613.988363:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417607424 00000100:00100000:1.0:1789265613.988408:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265613.988417:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+10:22738:x1876180417607424:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265613.988429:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265613.988443:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98066 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9805f expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.988464:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9805f expref: 11 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.988474:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9805f expref: 11 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265613.988482:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe800, rc 0) 00000100:00100000:1.0:1789265613.988519:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+11:22738:x1876180417607424:12345-0@lo:101:mount.lustre.0 Request processed in 103us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265613.988526:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265613.988653:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417607424:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265613.988678:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a9805f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98066 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265613.988686:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a9805f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a98066 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265613.988762:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417607552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265613.988789:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265613.988817:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd251c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789265613.988979:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417607552 00000100:00100000:1.0:1789265613.988983:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417607552 00000100:00100000:1.0:1789265613.989014:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265613.989059:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+11:22738:x1876180417607552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265613.989210:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+11:22738:x1876180417607552:12345-0@lo:501:mount.lustre.0 Request processed in 155us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265613.989217:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789265613.989351:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417607552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265613.989382:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417607680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265613.989420:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265613.989441:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3b3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265613.989459:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417607680 00000100:00100000:2.0:1789265613.989463:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417607680 00000100:00100000:2.0:1789265613.989493:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265613.989500:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+11:22738:x1876180417607680:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265613.989578:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+11:22738:x1876180417607680:12345-0@lo:503:mount.lustre.0 Request processed in 77us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265613.989584:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789265613.989639:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417607680:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265613.990378:0:22787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82fe313a-a4f8-4781-be1f-82c20160e337:22787:1876180417607808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265613.990421:0:22787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265613.990481:0:22787:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd2510c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265613.990519:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417607808 00000100:00100000:2.0:1789265613.990523:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417607808 00000100:00100000:2.0:1789265613.990583:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265613.990591:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b08b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+11:22787:x1876180417607808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789265613.991166:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b08b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+11:22787:x1876180417607808:12345-0@lo:502:llog_process_th.0 Request processed in 575us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265613.991173:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265613.991302:0:22787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82fe313a-a4f8-4781-be1f-82c20160e337:22787:1876180417607808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265613.991327:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265613.991336:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265613.991338:0:22787:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789265613.991345:0:22787:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fccbc1ce800 00000020:00000080:0.0:1789265613.991348:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789265613.991356:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265613.991359:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265613.991360:0:22787:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789265613.991363:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265613.991365:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265613.991366:0:22787:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789265613.991369:0:22787:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fccbc1ce800 00000020:00000080:0.0:1789265613.991371:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789265613.991452:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265613.991455:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265613.991457:0:22787:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789265613.991460:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265613.991462:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265613.991463:0:22787:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789265613.991467:0:22787:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fccbc1ce800 00000020:00000080:0.0:1789265613.991468:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789265614.001114:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265614.001128:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265614.001130:0:22787:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789265614.001134:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265614.001138:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265614.001140:0:22787:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789265614.001145:0:22787:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fccbc1ce800 00000020:00000080:0.0:1789265614.001154:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789265614.001237:0:22787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82fe313a-a4f8-4781-be1f-82c20160e337:22787:1876180417607936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265614.001316:0:22787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265614.001361:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417607936 00000100:00100000:0.0:1789265614.001368:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417607936 00000100:00100000:0.0:1789265614.001415:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265614.001423:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+11:22787:x1876180417607936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265614.001548:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+11:22787:x1876180417607936:12345-0@lo:502:llog_process_th.0 Request processed in 124us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265614.001557:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265614.001607:0:22787:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd2510c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265614.001766:0:22787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82fe313a-a4f8-4781-be1f-82c20160e337:22787:1876180417607936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789265614.001793:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265614.001798:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265614.001800:0:22787:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789265614.001803:0:22787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789265614.003114:0:22738:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789265614.003145:0:22738:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265614.004770:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a9805f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98066 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265614.004788:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a9805f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98066 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265614.004858:0:22738:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789265614.004862:0:22738:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fccbc1ce800 10000000:01000000:2.0:1789265614.004865:0:22738:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fccbc1ce800 10000000:01000000:2.0:1789265614.004870:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789265614.004876:0:22738:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fccbc1ce800 from 1 10000000:01000000:2.0:1789265614.004885:0:22738:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265614.004923:0:22738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fa00/0x9272d942b4a9806d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265614.004933:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fa00/0x9272d942b4a9806d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265614.004945:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fa00/0x9272d942b4a9806d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265614.004971:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417608064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265614.005054:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265614.005106:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b87780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265614.005136:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417608064 00000100:00100000:2.0:1789265614.005143:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417608064 00000100:00100000:2.0:1789265614.005193:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789265614.005202:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+11:22738:x1876180417608064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265614.005215:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265614.005228:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2e200/0x9272d942b4a98074 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9806d expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265614.005252:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2e200/0x9272d942b4a98074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9806d expref: 12 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265614.005264:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb84a2e200/0x9272d942b4a98074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9806d expref: 12 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265614.005271:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2e200, rc 0) 00000100:00100000:2.0:1789265614.005309:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+12:22738:x1876180417608064:12345-0@lo:101:mount.lustre.0 Request processed in 108us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265614.005327:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789265614.005371:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417608064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265614.005385:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fa00/0x9272d942b4a9806d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98074 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265614.005394:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fa00/0x9272d942b4a9806d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a98074 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265614.005446:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417608192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265614.005470:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265614.005486:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b87780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265614.006781:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417608192 00000100:00100000:1.0:1789265614.006792:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417608192 00000100:00100000:1.0:1789265614.006841:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265614.006850:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+12:22738:x1876180417608192:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265614.006996:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+12:22738:x1876180417608192:12345-0@lo:501:mount.lustre.0 Request processed in 146us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265614.007004:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789265614.008799:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417608192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265614.008850:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417608320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265614.008902:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265614.008937:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83b87780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265614.009770:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417608320 00000100:00100000:1.0:1789265614.009778:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417608320 00000100:00100000:1.0:1789265614.009823:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265614.009832:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+12:22738:x1876180417608320:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265614.009952:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+12:22738:x1876180417608320:12345-0@lo:503:mount.lustre.0 Request processed in 121us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265614.009960:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789265614.010247:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417608320:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265614.010835:0:22792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82fe313a-a4f8-4781-be1f-82c20160e337:22792:1876180417608448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265614.010887:0:22792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265614.010914:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417608448 00000100:00100000:0.0:1789265614.010917:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417608448 00000100:00100000:0.0:1789265614.010945:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265614.010953:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+12:22792:x1876180417608448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265614.011057:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+12:22792:x1876180417608448:12345-0@lo:502:llog_process_th.0 Request processed in 104us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265614.011064:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265614.011122:0:22792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd251c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265614.011144:0:22792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82fe313a-a4f8-4781-be1f-82c20160e337:22792:1876180417608448:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789265614.011199:0:22792:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789265614.011216:0:22792:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9fcc837eb370) 00000020:00000080:0.0:1789265614.011233:0:22792:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1789265614.011312:0:22792:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fccbc1ce800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789265614.011316:0:22792:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fccbc1ce800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789265614.011319:0:22792:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccbc1ce800 4 00010000:00080000:0.0:1789265614.011347:0:22792:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcb83c7e800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.149@tcp at head 00010000:00010000:0.0:1789265614.017289:0:22792:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1789265614.021455:0:22792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789265614.021502:0:22792:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789265614.021515:0:22792:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9272d942b4a98082 00000100:00080000:0.0:1789265614.021525:0:22792:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265614.021531:0:22792:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fcb83c7e800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265614.021564:0:22792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83d47480 x1876180417608576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265614.021603:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876180417608576:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789265614.023840:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265614.023933:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417608576 00000100:00100000:0.0:1789265614.023941:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417608576 00000100:00100000:0.0:1789265614.023975:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265614.023983:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876180417608576:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789265614.024082:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876180417608576:12345-0@lo:38:llog_process_th.0 Request processed in 88us (236us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789265614.024091:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265614.024135:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789265614.024143:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb83c7e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265614.024166:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789265614.024170:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876180417608576:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789265614.026170:0:22792:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789265614.026820:0:22792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82fe313a-a4f8-4781-be1f-82c20160e337:22792:1876180417608704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265614.026893:0:22792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265614.026928:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417608704 00000100:00100000:1.0:1789265614.026936:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417608704 00000100:00100000:1.0:1789265614.026974:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789265614.026982:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+12:22792:x1876180417608704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265614.027120:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+12:22792:x1876180417608704:12345-0@lo:502:llog_process_th.0 Request processed in 137us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265614.027134:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789265614.027179:0:22792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdb66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265614.027199:0:22792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82fe313a-a4f8-4781-be1f-82c20160e337:22792:1876180417608704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265614.027236:0:22792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82fe313a-a4f8-4781-be1f-82c20160e337:22792:1876180417608832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789265614.027268:0:22792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265614.027282:0:22792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838fa600 going to sleep for 11 seconds 00000100:00100000:0.0:1789265614.028571:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417608832 00000100:00100000:0.0:1789265614.028579:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417608832 00000100:00100000:0.0:1789265614.028616:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265614.028624:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+12:22792:x1876180417608832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789265614.030232:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+12:22792:x1876180417608832:12345-0@lo:502:llog_process_th.0 Request processed in 1598us (2953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265614.030245:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789265614.030466:0:22792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82fe313a-a4f8-4781-be1f-82c20160e337:22792:1876180417608832:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789265614.030502:0:22792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789265614.030573:0:22738:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789265614.030596:0:22738:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789265614.030611:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fa00/0x9272d942b4a9806d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98074 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.030622:0:22738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2fa00/0x9272d942b4a9806d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98074 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789265614.030669:0:22738:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789265614.030672:0:22738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789265614.030673:0:22738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265614.030675:0:22738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265614.030676:0:22738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265614.030678:0:22738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265614.030679:0:22738:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265614.030681:0:22738:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789265614.030683:0:22738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265614.030684:0:22738:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265614.030688:0:22738:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789265614.030694:0:22738:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789265614.030695:0:22738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789265614.030697:0:22738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265614.030698:0:22738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265614.030699:0:22738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265614.030700:0:22738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265614.030701:0:22738:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789265614.030702:0:22738:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789265614.030703:0:22738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265614.030704:0:22738:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789265614.030723:0:22738:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789265614.030739:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417608960:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789265614.030776:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265614.030803:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99280240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265614.030825:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417608960 00000100:00100000:0.0:1789265614.030830:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417608960 00000100:00100000:0.0:1789265614.030862:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789265614.030870:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+12:22738:x1876180417608960:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789265614.030892:0:22753:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789265614.030906:0:22753:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789265614.033702:0:22753:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789265614.033755:0:22753:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789265614.033994:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+12:22738:x1876180417608960:12345-0@lo:253:mount.lustre.0 Request processed in 3121us (3214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265614.034006:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265614.034135:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:22738:1876180417608960:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789265614.034147:0:22738:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789265614.034151:0:22738:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789265614.034153:0:22738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789265614.034154:0:22738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265614.034155:0:22738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265614.034157:0:22738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265614.034159:0:22738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265614.034160:0:22738:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789265614.034162:0:22738:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789265614.034164:0:22738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265614.034170:0:22738:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789265614.034186:0:22738:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1789265614.036502:0:22775:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789265614.036512:0:22775:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789265614.036533:0:22775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a98089 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265614.036552:0:22775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a98058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a98051 expref: 11 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265614.036560:0:22775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a98089 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265614.036597:0:22775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a98058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a98051 expref: 11 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265614.036612:0:22775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a98058 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a98051 expref: 11 pid: 22752 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265614.037110:0:22775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22775:1876180417609088:0@lo:104: 00000100:00100000:3.0:1789265614.037167:0:22775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265614.037207:0:22775:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacd3c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265614.038113:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417609088 00000100:00100000:3.0:1789265614.038122:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417609088 00000100:00100000:3.0:1789265614.038166:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265614.038175:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82fe313a-a4f8-4781-be1f-82c20160e337+3:22775:x1876180417609088:12345-0@lo:104: 00010000:00010000:3.0:1789265614.038191:0:22742:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a98051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a98058 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265614.038249:0:22742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789265614.038255:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82fe313a-a4f8-4781-be1f-82c20160e337+3:22775:x1876180417609088:12345-0@lo:104: Request processed in 81us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265614.038271:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789265614.038333:0:22775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22775:1876180417609088:0@lo:104: 00010000:00010000:3.0:1789265614.038353:0:22775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a98089 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.038537:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265614.038544:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a98051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a98058 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.038552:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff800 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:0.0:1789265614.038556:0:22748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a98051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a98058 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.038574:0:22748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a98051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a98058 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265614.038581:0:22748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a98051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a98058 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265614.038587:0:22748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789265614.038615:0:22748:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a98051 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98058 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.038621:0:22748:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265614.038640:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a98051 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98058 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.038647:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a98051 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98058 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.038660:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265614.038662:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265614.038664:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265614.038693:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265614.038703:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:82fe313a-a4f8-4781-be1f-82c20160e337:3644:1876180417609216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265614.038737:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265614.038785:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417609216 00000100:00100000:0.0:1789265614.038789:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417609216 00010000:00010000:0.0:1789265614.038804:0:22744:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a98058 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a98051 expref: 12 pid: 22752 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265614.038822:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265614.038834:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82fe313a-a4f8-4781-be1f-82c20160e337+12:3644:x1876180417609216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265614.038844:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265614.038849:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a98058 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a98051 expref: 12 pid: 22752 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.038859:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a98058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a98051 expref: 12 pid: 22752 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.038871:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a98058 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a98051 expref: 12 pid: 22752 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.038884:0:22744:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a98089 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.038893:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a98089 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789265614.038906:0:22744:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002394886s 00010000:00010000:0.0:1789265614.038911:0:22744:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a98089 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.038917:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a98089 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.038923:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a98089 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.038929:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a98089 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.038934:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265614.038942:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a98089 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.038949:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a98089 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.038964:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a98089 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.038973:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265614.039000:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82fe313a-a4f8-4781-be1f-82c20160e337+11:3644:x1876180417609216:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265614.039007:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265614.039047:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:82fe313a-a4f8-4781-be1f-82c20160e337:3644:1876180417609216:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265614.039062:0:22775:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a98089 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.039069:0:22775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a98089 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265614.039088:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a98089 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789265614.065514:0:22738:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:3.0:1789265614.065828:0:22738:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789265614.066011:0:22799:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:2.0:1789265614.066015:0:22799:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:3.0:1789265614.066103:0:22800:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789265614.066207:0:22738:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1789265614.066537:0:22800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1789265614.066664:0:22801:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9fcb83c99c00 x1876180417609344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265614.066675:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00000040:01000000:0.0:1789265614.066944:0:22738:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789265614.066972:0:22738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789265614.068477:0:22738:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789265614.068494:0:22738:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789265614.068564:0:22738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265614.070326:0:22738:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789265614.071070:0:22738:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789265614.071121:0:22738:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789265614.071216:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789265614.071283:0:22800:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1789265614.072173:0:22738:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1789265614.072866:0:22738:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1789265614.075003:0:22738:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1789265614.076969:0:22738:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789265614.077008:0:22738:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbf45c178f988 00100000:10000000:1.0:1789265614.077016:0:22738:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789265614.077853:0:22738:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789265614.077868:0:22738:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.149@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789265614.077890:0:22738:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789265614.077914:0:22738:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789265614.081691:0:22738:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265614.081872:0:22738:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789265614.724976:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789265615.041767:0:22793:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789265615.041777:0:22793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265615.047968:0:22793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789265615.047983:0:22793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789265615.106924:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00010000:00010000:2.0:1789265615.748586:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789265615.752483:0:22757:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789265615.752489:0:22757:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fccbc1ce800 from 11 10000000:01000000:2.0:1789265615.752507:0:22757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789265615.752548:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a98090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265615.752559:0:22757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a98090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265615.752570:0:22757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a98090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265615.752595:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417609472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265615.752659:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265615.752702:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdb6480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265615.752889:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417609472 00000100:00100000:1.0:1789265615.752897:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417609472 00000100:00100000:1.0:1789265615.753225:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789265615.753235:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+11:22757:x1876180417609472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265615.753247:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265615.753260:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a98097 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a98090 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265615.753282:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a98097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a98090 expref: 12 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265615.753291:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a98097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a98090 expref: 12 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265615.753300:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe000, rc 0) 00000100:00100000:1.0:1789265615.753351:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+12:22757:x1876180417609472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265615.753358:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265615.756134:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417609472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265615.756180:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a98090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98097 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265615.756193:0:22757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a98090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a98097 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265615.756271:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417609600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789265615.756334:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265615.756388:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdb6480 going to sleep for 11 seconds 00000100:00100000:1.0:1789265615.756470:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417609600 00000100:00100000:1.0:1789265615.756477:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417609600 00000100:00100000:1.0:1789265615.756530:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789265615.756539:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+12:22757:x1876180417609600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789265615.756559:0:22753:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789265615.756575:0:22753:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789265615.756578:0:22753:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1789265615.756662:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+12:22757:x1876180417609600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265615.756670:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265615.757597:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417609600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789265615.757650:0:22757:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789265615.757659:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a98090 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98097 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265615.757669:0:22757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a98090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98097 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265616.069542:0:22793:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789265616.069551:0:22793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789265616.069691:0:22793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1789265616.069730:0:22793:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789265616.069874:0:22793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1789265616.131697:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00010000:00010000:0.0:1789265616.776089:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265617.158992:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00010000:00010000:2.0:1789265617.793269:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789265617.932602:0:23044:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789265618.179149:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00010000:00010000:0.0:1789265618.826368:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789265618.831817:0:23096:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265618.832007:0:23096:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789265619.201137:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00000100:00080000:3.0:1789265619.460864:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789265619.460871:0:14028:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789265619.460875:0:14028:0:(import.c:65:import_set_state_nolock()) ffff9fcb83e09000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265619.460882:0:14028:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 665 00000100:00080000:3.0:1789265619.460887:0:14028:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789265619.460894:0:14028:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fcb83e09000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:3.0:1789265619.460918:0:14028:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb8495fb80 x1876180417609856/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265619.460955:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265619.460958:0:14028:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265619.460961:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265619.460964:0:14028:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265619.460967:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789265619.460970:0:14028:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789265619.460972:0:14028:0:(import.c:65:import_set_state_nolock()) ffff9fcb83c7e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265619.460977:0:14028:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fcb83c7e800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:3.0:1789265619.460990:0:14028:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb8495f800 x1876180417609984/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265619.461014:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265619.461060:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82fe313a-a4f8-4781-be1f-82c20160e337:3643:1876180417609728:0@lo:400:kworker.0 00000100:00100000:3.0:1789265619.461191:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265619.461243:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417609856:0@lo:38:kworker.0 00000100:00100000:3.0:1789265619.461289:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265619.461317:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876180417609984:0@lo:38:kworker.0 00000100:00100000:3.0:1789265619.461363:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265619.461720:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417609728 00000100:00100000:3.0:1789265619.461727:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417609728 00000100:00100000:3.0:1789265619.461773:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265619.461781:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+12:3643:x1876180417609728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265619.461830:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+12:3643:x1876180417609728:12345-0@lo:400:kworker.0 Request processed in 49us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265619.461849:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265619.461899:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82fe313a-a4f8-4781-be1f-82c20160e337:3643:1876180417609728:0@lo:400:kworker.0 00000100:00100000:1.0:1789265619.462003:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417609856 00000100:00100000:1.0:1789265619.462009:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417609856 00000100:00100000:1.0:1789265619.462174:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789265619.462181:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876180417609856:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789265619.462198:0:22765:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789265619.462238:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876180417609856:12345-0@lo:38:kworker.0 Request processed in 56us (948us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789265619.462245:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789265619.462291:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb83e09000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789265619.462307:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789265619.462311:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417609856:0@lo:38:kworker.0 00000100:00100000:0.0:1789265619.462952:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417609984 00000100:00100000:0.0:1789265619.462959:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417609984 00000100:00100000:0.0:1789265619.462992:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265619.462998:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876180417609984:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789265619.463018:0:22761:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:0.0:1789265619.463258:0:22761:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9272d942b4a9809e 00000004:00100000:0.0:1789265619.463272:0:22761:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789265619.463654:0:22761:0:(import.c:65:import_set_state_nolock()) ffff9fccb092f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265619.463718:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876180417609984:12345-0@lo:38:kworker.0 Request processed in 719us (2354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265619.463726:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789265619.463933:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fcb8495f800 x1876180417609984/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789265619.463947:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789265619.463954:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789265619.463958:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789265619.463960:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb83c7e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789265619.463966:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876180417609984:0@lo:38:kworker.0 00000020:00000004:1.0:1789265619.830002:0:23146:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265619.831497:0:23146:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789265619.847475:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265620.225604:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00010000:00010000:1.0:1789265620.865948:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265621.249073:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00010000:00010000:3.0:1789265621.893298:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265622.273943:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00010000:00010000:1.0:1789265622.923186:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265623.302826:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00000100:00100000:1.0:1789265623.554226:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265613/real 1789265613] req@ffff9fcb83c99500 x1876180417606912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265623 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265623.554258:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83c99500 x1876180417606912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265623 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265623.554269:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265613/real 1789265613] req@ffff9fcb83d44a80 x1876180417606784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265623 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265623.554281:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83d44a80 x1876180417606784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265623 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789265623.554299:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccb4fdb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265623.554322:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789265623.554326:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417606912:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789265623.554332:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcc82d4e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265623.554337:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789265623.554340:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417606784:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789265623.554485:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789265623.554490:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789265623.554493:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcb83e09000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265623.554498:0:17249:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 670 00000100:00080000:3.0:1789265623.554503:0:17249:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789265623.554509:0:17249:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fcb83e09000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:3.0:1789265623.554532:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb8495fb80 x1876180417610240/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265623.554554:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265623.554557:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789265623.554568:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcc82d4e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265623.554572:0:17249:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 665 00000100:00080000:3.0:1789265623.554575:0:17249:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789265623.554578:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fcc82d4e000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:3.0:1789265623.554592:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb8495c380 x1876180417610368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265623.554600:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265623.554603:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789265623.554605:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fccb4fdb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265623.554607:0:17249:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 665 00000100:00080000:3.0:1789265623.554610:0:17249:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789265623.554613:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fccb4fdb800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:3.0:1789265623.554623:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb8495e680 x1876180417610496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265623.554681:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417610624:0@lo:400:kworker.0 00000100:00100000:3.0:1789265623.554753:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265623.554793:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789265623.554799:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82fe313a-a4f8-4781-be1f-82c20160e337:3642:1876180417610112:0@lo:400:kworker.0 00000100:00100000:3.0:1789265623.554826:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265623.554862:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417610112 00000100:00100000:3.0:1789265623.554869:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417610112 00000100:00100000:3.0:1789265623.554908:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265623.554917:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+12:3642:x1876180417610112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265623.554962:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+12:3642:x1876180417610112:12345-0@lo:400:kworker.0 Request processed in 47us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265623.554979:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265623.555050:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82fe313a-a4f8-4781-be1f-82c20160e337:3642:1876180417610112:0@lo:400:kworker.0 00000100:00100000:0.0:1789265623.555142:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417610624 00000100:00100000:0.0:1789265623.555147:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417610624 00000100:00100000:0.0:1789265623.555188:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265623.555195:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417610624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265623.555241:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417610624:12345-0@lo:400:kworker.0 Request processed in 46us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265623.555248:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789265623.555312:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fcb8495ed80 x1876180417610624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265623.555460:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417610624:0@lo:400:kworker.0 00000100:00100000:1.0:1789265623.555587:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417610240:0@lo:38:kworker.0 00000100:00100000:1.0:1789265623.555620:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265623.555649:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417610368:0@lo:8:kworker.0 00000400:00000100:1.0:1789265623.555666:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417610368 offset 0 length 520: 4 00000100:00100000:1.0:1789265623.555684:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417610496:0@lo:8:kworker.0 00000400:00000100:1.0:1789265623.555699:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417610496 offset 0 length 520: 4 00000100:00100000:0.0:1789265623.555825:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417610240 00000100:00100000:0.0:1789265623.555830:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417610240 00000100:00100000:0.0:1789265623.555859:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265623.555863:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1876180417610240:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789265623.555878:0:22764:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789265623.555916:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1876180417610240:12345-0@lo:38:kworker.0 Request processed in 51us (295us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789265623.555922:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789265623.555950:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb83e09000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265623.555954:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789265623.555957:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417610240:0@lo:38:kworker.0 00010000:00010000:1.0:1789265623.942137:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265624.322155:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00010000:00010000:1.0:1789265624.971518:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265625.352317:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00010000:00010000:0.0:1789265625.986383:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265626.317604:0:22793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789265626.369156:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00010000:00010000:1.0:1789265627.009218:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789265627.045472:0:23491:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789265627.045476:0:23491:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789265627.045477:0:23491:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789265627.045592:0:23491:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fccb092a000 00000020:01000004:0.0:1789265627.045608:0:23491:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1789265627.045620:0:23491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789265627.045632:0:23491:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9fcc837e8000) 00000020:00000080:0.0:1789265627.045650:0:23491:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789265627.085827:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789265627.086357:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1789265627.086758:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1789265627.086916:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789265627.087234:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789265627.087432:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789265627.087784:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789265627.087973:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789265627.088187:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1789265627.088380:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789265627.088588:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789265627.088766:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789265627.088945:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789265627.089206:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789265627.091158:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789265627.091381:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789265627.091577:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789265627.092310:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789265627.092594:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1789265627.092809:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789265627.093123:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789265627.093297:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789265627.093570:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789265627.093780:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1789265627.094156:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1789265627.094436:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1789265627.094626:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789265627.094807:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1789265627.095119:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1789265627.095302:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789265627.095578:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789265627.095799:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1789265627.096082:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1789265627.096299:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1789265627.096573:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789265627.096816:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1789265627.097113:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1789265627.097406:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789265627.097634:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789265627.097865:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1789265627.098199:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789265627.098433:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789265627.098679:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789265627.098897:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789265627.099197:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789265627.099507:0:23491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00080000:01000000:0.0:1789265627.100502:0:23491:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789265627.100764:0:23491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789265627.100776:0:23491:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789265627.100788:0:23491:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a980ac 00000020:01000004:0.0:1789265627.100796:0:23491:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789265627.100818:0:23491:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.149@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789265627.100822:0:23491:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.149@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789265627.100828:0:23491:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789265627.100854:0:23491:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789265627.100859:0:23491:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.149@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789265627.107000:0:23491:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.149@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789265627.107505:0:23491:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.149@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1789265627.107510:0:23491:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789265627.107511:0:23491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789265627.107512:0:23491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265627.107513:0:23491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265627.107514:0:23491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265627.107515:0:23491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265627.107516:0:23491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789265627.107517:0:23491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265627.107522:0:23491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789265627.107525:0:23491:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1789265627.107527:0:23491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789265627.107528:0:23491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789265627.107529:0:23491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265627.107530:0:23491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265627.107530:0:23491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265627.107531:0:23491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265627.107532:0:23491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789265627.107533:0:23491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265627.107534:0:23491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789265627.107560:0:23491:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789265627.107579:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417610752:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789265627.107648:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.107695:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0ab0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265627.107796:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417610752 00000100:00100000:3.0:1789265627.107805:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417610752 00000100:00100000:3.0:1789265627.107854:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789265627.107864:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+12:23491:x1876180417610752:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789265627.107891:0:22753:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789265627.107895:0:22753:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1789265627.107903:0:22753:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789265627.108333:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+12:23491:x1876180417610752:12345-0@lo:253:mount.lustre.0 Request processed in 469us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265627.108341:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789265627.108576:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417610752:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789265627.108587:0:23491:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789265627.108589:0:23491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789265627.108591:0:23491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789265627.108592:0:23491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265627.108593:0:23491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265627.108594:0:23491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265627.108596:0:23491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265627.108597:0:23491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789265627.108598:0:23491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265627.108599:0:23491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789265627.108619:0:23491:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fccb092a000 from lustre-MDT0001 10000000:01000000:2.0:1789265627.108646:0:23491:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789265627.108649:0:23491:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789265627.108655:0:23491:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fccb09b3370 local copy 00010000:00010000:2.0:1789265627.108666:0:23491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a97fa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fa9 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265627.108764:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417610880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265627.108802:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.108861:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0ab0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265627.108897:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417610880 00000100:00100000:3.0:1789265627.108903:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417610880 00000100:00100000:3.0:1789265627.108966:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789265627.108974:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+12:23491:x1876180417610880:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265627.109083:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+12:23491:x1876180417610880:12345-0@lo:501:mount.lustre.0 Request processed in 109us (280us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789265627.109090:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789265627.109263:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417610880:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789265627.109276:0:23491:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.149@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789265627.109295:0:23491:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.149@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789265627.109301:0:23491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a97fa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fa9 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.109309:0:23491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a97fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fa9 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265627.109333:0:23491:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fccb092a000 10000000:01000000:1.0:1789265627.109337:0:23491:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789265627.109342:0:23491:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fccb09b3370 10000000:01000000:1.0:1789265627.109344:0:23491:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789265627.109429:0:23491:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fccb09b3370 from 1 10000000:01000000:1.0:1789265627.109433:0:23491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789265627.109457:0:23491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a980b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.109465:0:23491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a980b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.109475:0:23491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a980b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265627.109487:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417611008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265627.109525:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265627.109815:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3426c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265627.109879:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417611008 00000100:00100000:2.0:1789265627.109885:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417611008 00000100:00100000:2.0:1789265627.109909:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789265627.109915:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+12:23491:x1876180417611008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265627.109924:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265627.109937:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2e400/0x9272d942b4a980ba lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a980b3 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.109957:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2e400/0x9272d942b4a980ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a980b3 expref: 13 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.109968:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb84a2e400/0x9272d942b4a980ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a980b3 expref: 13 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.109976:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2e400, rc 0) 00000100:00100000:2.0:1789265627.110036:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+13:23491:x1876180417611008:12345-0@lo:101:mount.lustre.0 Request processed in 108us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265627.110042:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789265627.110119:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417611008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265627.110132:0:23491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a980b3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a980ba expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.110151:0:23491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a980b3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a980ba expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265627.110168:0:23491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789265627.110182:0:23491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a980b3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a980ba expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.110188:0:23491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fe200/0x9272d942b4a980b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a980ba expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265627.110196:0:23491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fccb092a000 10000000:01000000:1.0:1789265627.110200:0:23491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789265627.110203:0:23491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fccb092a000 from 1 10000000:01000000:1.0:1789265627.110205:0:23491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789265627.110216:0:23491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffa00/0x9272d942b4a980c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.110224:0:23491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffa00/0x9272d942b4a980c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.110231:0:23491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffa00/0x9272d942b4a980c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265627.110243:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417611136:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265627.110277:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265627.110294:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3426c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265627.110607:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417611136 00000100:00100000:2.0:1789265627.110611:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417611136 00000100:00100000:2.0:1789265627.110632:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789265627.110637:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+13:23491:x1876180417611136:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265627.110643:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265627.110651:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a980c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a980c1 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.110663:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a980c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a980c1 expref: 14 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.110676:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb84a2f800/0x9272d942b4a980c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a980c1 expref: 14 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.110682:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2f800, rc 0) 00000100:00100000:2.0:1789265627.110725:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+14:23491:x1876180417611136:12345-0@lo:101:mount.lustre.0 Request processed in 87us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265627.110731:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789265627.110803:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417611136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265627.110813:0:23491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffa00/0x9272d942b4a980c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a980c8 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.110822:0:23491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffa00/0x9272d942b4a980c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a980c8 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265627.110833:0:23491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789265627.110846:0:23491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffa00/0x9272d942b4a980c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a980c8 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.110853:0:23491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ffa00/0x9272d942b4a980c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a980c8 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265627.110858:0:23491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789265627.110861:0:23491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265627.110866:0:23491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fccb092a000 10000000:01000000:1.0:1789265627.110868:0:23491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789265627.110872:0:23491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1789265627.110874:0:23491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789265627.110887:0:23491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a980cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.110894:0:23491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a980cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.110901:0:23491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a980cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265627.110919:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417611264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265627.110944:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265627.110956:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3426c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265627.111012:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417611264 00000100:00100000:2.0:1789265627.111016:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417611264 00000100:00100000:2.0:1789265627.111065:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265627.111071:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+14:23491:x1876180417611264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265627.111078:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265627.111086:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a980d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a980cf expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.111099:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a980d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a980cf expref: 15 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.111107:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb84a2e600/0x9272d942b4a980d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a980cf expref: 15 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.111113:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2e600, rc 0) 00000100:00100000:2.0:1789265627.111152:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+15:23491:x1876180417611264:12345-0@lo:101:mount.lustre.0 Request processed in 81us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265627.111157:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789265627.111289:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417611264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265627.111299:0:23491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a980cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a980d6 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.111307:0:23491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a980cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a980d6 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265627.117467:0:23491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1789265627.118237:0:23491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265627.125827:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1789265627.125881:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1789265627.125895:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1789265627.125908:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1789265627.125921:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1789265627.125935:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1789265627.125947:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1789265627.125961:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1789265627.125975:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1789265627.127244:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1789265627.127265:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1789265627.127294:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1789265627.127306:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1789265627.127317:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1789265627.127329:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1789265627.127342:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1789265627.127430:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1789265627.127444:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1789265627.127456:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1789265627.127468:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1789265627.127479:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1789265627.127491:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1789265627.127503:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1789265627.127531:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1789265627.127547:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1789265627.127559:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1789265627.127572:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1789265627.127585:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1789265627.127599:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1789265627.127611:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1789265627.127621:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1789265627.127632:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1789265627.127654:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1789265627.127666:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1789265627.127677:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1789265627.127687:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1789265627.127699:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1789265627.127712:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1789265627.127724:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1789265627.127748:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1789265627.127761:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1789265627.127771:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1789265627.127782:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1789265627.127793:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1789265627.127824:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1789265627.127829:0:23491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1789265627.127929:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417611392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265627.127999:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.128071:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0ab00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265627.128084:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417611392 00000100:00100000:0.0:1789265627.128092:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417611392 00000100:00100000:0.0:1789265627.128149:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265627.128158:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+15:23491:x1876180417611392:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265627.128297:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+15:23491:x1876180417611392:12345-0@lo:501:mount.lustre.0 Request processed in 140us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265627.128304:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789265627.128855:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417611392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265627.128890:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417611520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265627.128930:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.129148:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0ab00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265627.129201:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417611520 00000100:00100000:0.0:1789265627.129207:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417611520 00000100:00100000:0.0:1789265627.129244:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789265627.129251:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+15:23491:x1876180417611520:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265627.129952:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+15:23491:x1876180417611520:12345-0@lo:503:mount.lustre.0 Request processed in 699us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265627.129961:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789265627.130152:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417611520:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789265627.130671:0:23491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265627.130737:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417611648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265627.130777:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.130843:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0ab00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265627.132483:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417611648 00000100:00100000:0.0:1789265627.132495:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417611648 00000100:00100000:2.0:1789265627.135109:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789265627.135123:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+15:23491:x1876180417611648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265627.137916:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+15:23491:x1876180417611648:12345-0@lo:502:mount.lustre.0 Request processed in 2786us (7128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265627.137931:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789265627.137972:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417611648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265627.138265:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789265627.138295:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1789265627.138309:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1789265627.138321:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1789265627.138334:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1789265627.138470:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1789265627.138500:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1789265627.138514:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1789265627.138528:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1789265627.138541:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1789265627.138555:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1789265627.138568:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1789265627.138582:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1789265627.138596:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1789265627.138610:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1789265627.138623:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1789265627.138635:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1789265627.138892:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1789265627.138909:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1789265627.138922:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1789265627.138941:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1789265627.138955:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1789265627.138969:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1789265627.139209:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1789265627.139227:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1789265627.139240:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1789265627.139253:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1789265627.139269:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1789265627.139300:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1789265627.139316:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1789265627.139330:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1789265627.139344:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1789265627.139429:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1789265627.139446:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1789265627.139461:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1789265627.139475:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1789265627.139490:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1789265627.139504:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1789265627.139517:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1789265627.139541:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1789265627.139554:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1789265627.139567:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1789265627.139581:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1789265627.139594:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1789265627.139753:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417611776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265627.139819:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265627.139867:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd0c0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265627.140056:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417611776 00000100:00100000:0.0:1789265627.140064:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417611776 00000100:00100000:0.0:1789265627.140115:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789265627.140124:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+15:23491:x1876180417611776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265627.140238:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+15:23491:x1876180417611776:12345-0@lo:502:mount.lustre.0 Request processed in 114us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265627.140246:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789265627.140370:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417611776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265627.140416:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1789265627.140425:0:23491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1789265627.142930:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265627.142944:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265627.142947:0:23495:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789265627.142953:0:23495:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789265627.142956:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265627.142969:0:23495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9fccbc9c3370) 00000020:00000080:3.0:1789265627.143000:0:23495:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1789265627.143006:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789265627.143123:0:23495:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789265627.143131:0:23495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a980e4 00000020:00000080:3.0:1789265627.143522:0:23495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789265627.143591:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265627.143596:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265627.143598:0:23495:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789265627.143601:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265627.143605:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265627.143606:0:23495:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789265627.143610:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265627.143617:0:23495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9fccbc9c0000) 00000020:00000080:3.0:1789265627.143629:0:23495:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1789265627.143633:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789265627.143635:0:23495:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789265627.143638:0:23495:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789265627.143644:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789265627.143709:0:23495:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fccb092a000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789265627.143723:0:23495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9fccbc9c4d28) 00000020:00000080:3.0:1789265627.143732:0:23495:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1789265627.143780:0:23495:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789265627.143786:0:23495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a980f9 00000020:00000080:3.0:1789265627.143876:0:23495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789265627.143882:0:23495:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789265627.143886:0:23495:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x9272d942b4a98100 00080000:01000000:3.0:1789265627.143892:0:23495:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789265627.143895:0:23495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a98107 00010000:00010000:0.0:1789265627.252745:0:23495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1789265627.253768:0:23495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:0.0:1789265627.254451:0:23495:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789265627.255523:0:23495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789265627.255534:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265627.255541:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265627.255548:0:23495:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789265627.255552:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265627.255557:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265627.255559:0:23495:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789265627.255562:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789265627.255567:0:23495:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000020:00000080:0.0:1789265627.255593:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789265627.255607:0:23495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9fcc837e99b8) 00000020:00000080:0.0:1789265627.255626:0:23495:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1789265627.255630:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789265627.255717:0:23495:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789265627.255724:0:23495:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789265627.255738:0:23495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a98115 00010000:00080000:0.0:1789265627.255770:0:23495:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcc986f5000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.149@tcp at head 00010000:00010000:0.0:1789265627.261811:0:23495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1789265627.265716:0:23495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789265627.265732:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789265627.265781:0:23495:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789265627.265802:0:23495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a9811c 00000100:00080000:0.0:1789265627.265812:0:23495:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265627.265818:0:23495:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fcc986f5000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265627.265854:0:23495:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83d47480 x1876180417611904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265627.265888:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417611904:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789265627.266085:0:23495:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1789265627.266150:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265627.266155:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265627.266157:0:23495:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789265627.266161:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789265627.266163:0:23495:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789265627.266165:0:23495:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789265627.266166:0:23495:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789265627.266174:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789265627.266177:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265627.266179:0:23495:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789265627.266181:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265627.266186:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265627.266188:0:23495:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789265627.266192:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789265627.266232:0:23495:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789265627.266249:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265627.266253:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265627.266255:0:23495:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789265627.266257:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789265627.266258:0:23495:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1789265627.266259:0:23495:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789265627.266261:0:23495:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789265627.266263:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789265627.266265:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265627.266267:0:23495:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789265627.266269:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789265627.266273:0:23495:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789265627.266276:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265627.266277:0:23495:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789265627.266280:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789265627.266284:0:23495:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000020:01000000:1.0:1789265627.266308:0:23495:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789265627.266310:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789265627.266324:0:23495:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9fccbc583370) 00000020:00000080:1.0:1789265627.266336:0:23495:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789265627.266340:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789265627.266522:0:23495:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789265627.266530:0:23495:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789265627.266535:0:23495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a9812a 00010000:00080000:1.0:1789265627.266563:0:23495:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcc83e0d800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.149@tcp at head 00010000:00010000:1.0:1789265627.266780:0:23495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1789265627.267435:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789265627.267928:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789265627.267935:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789265627.267944:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcb83e09000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265627.267949:0:17249:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 674 00000100:00080000:2.0:1789265627.267954:0:17249:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789265627.267959:0:17249:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fcb83e09000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265627.267994:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83c99180 x1876180417612032/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265627.268011:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265627.268015:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265627.268017:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265627.268020:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789265627.268079:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417612160:0@lo:400:kworker.0 00000100:00100000:2.0:1789265627.268118:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.268298:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417612160 00000100:00100000:2.0:1789265627.268305:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417612160 00000100:00100000:2.0:1789265627.268343:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265627.268426:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417612160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265627.268475:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417612160:12345-0@lo:400:kworker.0 Request processed in 53us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265627.268482:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789265627.268517:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fcb83c9b480 x1876180417612160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265627.268529:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417612160:0@lo:400:kworker.0 00000100:00100000:0.0:1789265627.268602:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417612032:0@lo:38:kworker.0 00000100:00100000:0.0:1789265627.268630:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.269874:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417611904 00000100:00100000:2.0:1789265627.269884:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417611904 00000100:00100000:2.0:1789265627.269930:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417612032 00000100:00100000:2.0:1789265627.269933:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417612032 00000100:00100000:2.0:1789265627.269946:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265627.269953:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876180417611904:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789265627.269977:0:22765:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:2.0:1789265627.270041:0:22765:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a98131 00000004:00100000:2.0:1789265627.270057:0:22765:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789265627.270063:0:22765:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:3.0:1789265627.270678:0:23495:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789265627.271149:0:23495:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789265627.273854:0:23495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265627.276699:0:23495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1789265627.276872:0:23495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789265627.279630:0:23500:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789265627.279694:0:23500:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00080000:1.0:1789265627.282134:0:22765:0:(import.c:65:import_set_state_nolock()) ffff9fcc986f4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265627.282255:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1876180417611904:12345-0@lo:38:llog_process_th.0 Request processed in 12299us (14819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265627.282266:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265627.282294:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265627.282301:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876180417612032:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1789265627.282307:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789265627.282316:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789265627.282324:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789265627.282329:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789265627.282332:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcc986f5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789265627.282351:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876180417612032:12345-0@lo:38:kworker.0 Request processed in 49us (13719us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789265627.282357:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265627.282425:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417611904:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789265627.282452:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789265627.282457:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb83e09000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265627.282460:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789265627.282463:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417612032:0@lo:38:kworker.0 00000100:00100000:0.0:1789265627.282777:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265627.282789:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417612288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265627.282825:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265627.282858:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417612288 00000100:00100000:0.0:1789265627.282863:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417612288 00000100:00100000:0.0:1789265627.282901:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265627.282908:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876180417612288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265627.282945:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789265627.283048:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876180417612288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265627.283055:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265627.283087:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417612288:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1789265627.284289:0:23495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789265627.284304:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789265627.284430:0:23495:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789265627.284453:0:23495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a98138 00000100:00080000:3.0:1789265627.284461:0:23495:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265627.284467:0:23495:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fcc83e0d800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:3.0:1789265627.284494:0:23495:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb8495ca80 x1876180417612416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265627.284515:0:23495:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789265627.284574:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265627.284580:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265627.284582:0:23495:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789265627.284585:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789265627.284587:0:23495:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1789265627.284589:0:23495:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265627.284590:0:23495:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789265627.284592:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789265627.284594:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265627.284596:0:23495:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789265627.284598:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789265627.284615:0:23495:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789265627.284620:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265627.284621:0:23495:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789265627.284624:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789265627.284628:0:23495:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.149@tcp to nid 0x20000c0a8cb95 (192.168.203.149@tcp) 00000100:00080000:2.0:1789265627.284749:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265627.284754:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265627.284757:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265627.284759:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1789265627.284906:0:23495:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789265627.284909:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265627.284999:0:23495:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9fccbc9c19b8) 00000020:00000080:3.0:1789265627.285013:0:23495:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1789265627.285019:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789265627.285102:0:23495:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789265627.285110:0:23495:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789265627.285116:0:23495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9272d942b4a98146 00010000:00080000:3.0:1789265627.285263:0:23495:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcca789a800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.149@tcp at head 00010000:00010000:3.0:1789265627.285706:0:23495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789265627.285876:0:23495:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789265627.285889:0:23495:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1789265627.288144:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417612416:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789265627.288213:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417612416 offset 0 length 520: 4 00000040:00080000:3.0:1789265627.290869:0:23495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265627.291275:0:23495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1789265627.291589:0:23495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1789265627.292494:0:23502:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789265627.292500:0:23502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789265627.293830:0:23495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789265627.293843:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789265627.293880:0:23495:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789265627.293901:0:23495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a9814d 00000100:00080000:0.0:1789265627.294115:0:23495:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265627.294122:0:23495:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fcca789a800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265627.294229:0:23495:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83d47800 x1876180417612544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265627.294252:0:23495:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789265627.294364:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265627.294369:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265627.294371:0:23495:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789265627.294374:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265627.294378:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265627.294379:0:23495:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789265627.294383:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789265627.294385:0:23495:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789265627.294387:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265627.294389:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265627.294391:0:23495:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789265627.294393:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265627.294395:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265627.294397:0:23495:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789265627.294401:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789265627.294559:0:23495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265627.294563:0:23495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265627.294565:0:23495:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789265627.294568:0:23495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00100000:1.0:1789265627.295122:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417612544:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789265627.295196:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417612544 offset 0 length 520: 4 00000100:00080000:2.0:1789265627.295255:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265627.295260:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265627.295263:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265627.295265:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1789265627.295285:0:23491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1789265627.295318:0:23491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789265627.295338:0:23491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a980cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a980d6 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.295471:0:23491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff800/0x9272d942b4a980cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a980d6 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265627.295480:0:23491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fccb092a000 from 1 10000000:01000000:2.0:1789265627.295490:0:23491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789265627.295519:0:23491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a98154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.295537:0:23491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a98154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.295547:0:23491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a98154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265627.295564:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417612672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265627.295603:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.295621:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0ab0780 going to sleep for 11 seconds 00000100:00100000:2.0:1789265627.295648:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417612672 00000100:00100000:2.0:1789265627.295655:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417612672 00000100:00100000:2.0:1789265627.295704:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265627.295713:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+15:23491:x1876180417612672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265627.295725:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265627.295736:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2f600/0x9272d942b4a9815b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a98154 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.295770:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2f600/0x9272d942b4a9815b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a98154 expref: 16 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.295780:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb84a2f600/0x9272d942b4a9815b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a98154 expref: 16 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.295789:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2f600, rc 0) 00000100:00100000:2.0:1789265627.295823:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+16:23491:x1876180417612672:12345-0@lo:101:mount.lustre.0 Request processed in 111us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265627.295838:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265627.295880:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417612672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265627.295892:0:23491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a98154 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9815b expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.295901:0:23491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a98154 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9815b expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265627.297260:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417612800:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789265627.297311:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.297457:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0ab0780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265627.297845:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417612800 00000100:00100000:1.0:1789265627.297852:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417612800 00000100:00100000:1.0:1789265627.298131:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789265627.298243:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+16:23491:x1876180417612800:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789265627.298268:0:22752:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789265627.298286:0:22752:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789265627.298289:0:22752:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1789265627.298739:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+16:23491:x1876180417612800:12345-0@lo:256:mount.lustre.0 Request processed in 499us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265627.298757:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265627.298884:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417612800:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789265627.300523:0:23491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789265627.300707:0:23491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a98154 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9815b expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.300719:0:23491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a98154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9815b expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265627.300728:0:23491:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccb092a000 from 1 10000000:01000000:2.0:1789265627.300730:0:23491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265627.300832:0:23491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ea00/0x9272d942b4a98162 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.300841:0:23491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ea00/0x9272d942b4a98162 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.300865:0:23491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ea00/0x9272d942b4a98162 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265627.300885:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417612928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265627.300934:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.301044:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0ab0780 going to sleep for 11 seconds 00000100:00100000:1.0:1789265627.301316:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417612928 00000100:00100000:1.0:1789265627.301323:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417612928 00000100:00100000:1.0:1789265627.301750:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789265627.301762:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+16:23491:x1876180417612928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265627.301774:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265627.301789:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a98169 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a98162 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.301813:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a98169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a98162 expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.301823:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a98169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a98162 expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.301832:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fec00, rc 0) 00000100:00100000:1.0:1789265627.301887:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+17:23491:x1876180417612928:12345-0@lo:101:mount.lustre.0 Request processed in 127us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265627.301893:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789265627.301967:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417612928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265627.301995:0:23491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ea00/0x9272d942b4a98162 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98169 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265627.302004:0:23491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ea00/0x9272d942b4a98162 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a98169 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265627.304055:0:23491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:3.0:1789265627.304333:0:23491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265627.304843:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789265627.304868:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1789265627.304884:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1789265627.304898:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1789265627.304911:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1789265627.304922:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1789265627.304933:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:3.0:1789265627.304943:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:3.0:1789265627.304954:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789265627.304964:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:3.0:1789265627.304976:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:3.0:1789265627.305004:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:3.0:1789265627.305009:0:23491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:3.0:1789265627.305107:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417613056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265627.305176:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265627.305797:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc8151ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265627.305925:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417613056 00000100:00100000:2.0:1789265627.305932:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417613056 00000100:00100000:2.0:1789265627.305972:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789265627.305997:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+17:23491:x1876180417613056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265627.306129:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+17:23491:x1876180417613056:12345-0@lo:501:mount.lustre.0 Request processed in 132us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265627.306248:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789265627.306342:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417613056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265627.306387:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417613184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265627.306548:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265627.306575:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc8151ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265627.306722:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417613184 00000100:00100000:2.0:1789265627.306727:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417613184 00000100:00100000:2.0:1789265627.306759:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789265627.306765:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+17:23491:x1876180417613184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265627.306840:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+17:23491:x1876180417613184:12345-0@lo:503:mount.lustre.0 Request processed in 74us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265627.306847:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789265627.306964:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417613184:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789265627.307842:0:23491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265627.307907:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417613312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265627.307953:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265627.308096:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc8151ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265627.308318:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417613312 00000100:00100000:1.0:1789265627.308324:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417613312 00000100:00100000:1.0:1789265627.308435:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789265627.308444:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+17:23491:x1876180417613312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265627.308552:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+17:23491:x1876180417613312:12345-0@lo:502:mount.lustre.0 Request processed in 108us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265627.308560:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789265627.308752:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417613312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265627.308914:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1789265627.308958:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1789265627.308974:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1789265627.309007:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1789265627.309019:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1789265627.309064:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1789265627.309076:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1789265627.309088:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1789265627.309099:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1789265627.309110:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1789265627.309122:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1789265627.309155:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417613440:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265627.309190:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265627.309217:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc8151ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265627.309453:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417613440 00000100:00100000:1.0:1789265627.309459:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417613440 00000100:00100000:1.0:1789265627.309481:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789265627.309487:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+17:23491:x1876180417613440:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265627.309574:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+17:23491:x1876180417613440:12345-0@lo:502:mount.lustre.0 Request processed in 86us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265627.309582:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789265627.309924:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417613440:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265627.309970:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1789265627.309994:0:23491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789265627.310907:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265627.310915:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265627.310918:0:23504:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789265627.310925:0:23504:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fccb092a000 00000020:00000080:1.0:1789265627.310927:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265627.310935:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265627.310937:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265627.310939:0:23504:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789265627.310941:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265627.310943:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265627.310945:0:23504:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789265627.310948:0:23504:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fccb092a000 00000020:00000080:1.0:1789265627.310950:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265627.311053:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265627.311069:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265627.311071:0:23504:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789265627.311073:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265627.311076:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265627.311077:0:23504:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789265627.311080:0:23504:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fccb092a000 00000020:00000080:1.0:1789265627.311082:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265627.311098:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265627.311100:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265627.311102:0:23504:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789265627.311104:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789265627.311106:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265627.311107:0:23504:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789265627.311110:0:23504:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fccb092a000 00000020:00000080:1.0:1789265627.311112:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789265627.311145:0:23504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789265627.311148:0:23504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789265627.311149:0:23504:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789265627.311152:0:23504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1789265627.322603:0:23491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789265627.323079:0:23491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265627.323103:0:23491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ea00/0x9272d942b4a98162 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98169 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265627.323117:0:23491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ea00/0x9272d942b4a98162 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98169 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265627.323245:0:23491:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789265627.323249:0:23491:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fccb092a000 10000000:01000000:3.0:1789265627.323252:0:23491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fccb092a000 10000000:01000000:3.0:1789265627.323255:0:23491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265627.323262:0:23491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fccb092a000 from 1 10000000:01000000:3.0:1789265627.323265:0:23491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265627.323304:0:23491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53e00/0x9272d942b4a98170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265627.323312:0:23491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53e00/0x9272d942b4a98170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265627.323322:0:23491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53e00/0x9272d942b4a98170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265627.323343:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417613568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789265627.324301:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265627.324337:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417613568 00000100:00100000:3.0:1789265627.324343:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417613568 00000100:00100000:2.0:1789265627.324508:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada7d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789265627.324845:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789265627.324853:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+17:23491:x1876180417613568:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265627.324866:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265627.324880:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f53800/0x9272d942b4a98177 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a98170 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265627.324902:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f53800/0x9272d942b4a98177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a98170 expref: 18 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265627.324912:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f53800/0x9272d942b4a98177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a98170 expref: 18 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265627.324920:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f53800, rc 0) 00000100:00100000:3.0:1789265627.324963:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+18:23491:x1876180417613568:12345-0@lo:101:mount.lustre.0 Request processed in 111us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265627.324969:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789265627.325237:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417613568:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265627.325252:0:23491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53e00/0x9272d942b4a98170 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98177 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.325261:0:23491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53e00/0x9272d942b4a98170 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a98177 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265627.330282:0:23491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1789265627.330628:0:23491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265627.330891:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1789265627.330915:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1789265627.330930:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1789265627.330945:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1789265627.330958:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1789265627.330971:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1789265627.331002:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1789265627.331051:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1789265627.331068:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1789265627.331081:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1789265627.331094:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1789265627.331107:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1789265627.331120:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1789265627.331133:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1789265627.331820:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1789265627.331835:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1789265627.331846:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1789265627.331857:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1789265627.331868:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1789265627.331879:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1789265627.331890:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1789265627.331901:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1789265627.331912:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1789265627.331936:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1789265627.331949:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1789265627.331960:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1789265627.331971:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1789265627.332272:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1789265627.332285:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1789265627.332304:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1789265627.332315:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1789265627.332327:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1789265627.332340:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1789265627.332429:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1789265627.332442:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1789265627.332453:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1789265627.332464:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1789265627.332476:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1789265627.332487:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1789265627.332509:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1789265627.332623:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1789265627.332695:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1789265627.332712:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1789265627.332724:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1789265627.332735:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1789265627.332799:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1789265627.332814:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1789265627.332826:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1789265627.332938:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1789265627.332955:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1789265627.332970:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1789265627.332974:0:23491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1789265627.333523:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417613696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265627.334133:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.334506:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417613696 00000100:00100000:2.0:1789265627.334514:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417613696 00000100:00100000:2.0:1789265627.334567:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789265627.334576:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+18:23491:x1876180417613696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265627.335239:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+18:23491:x1876180417613696:12345-0@lo:501:mount.lustre.0 Request processed in 662us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265627.335253:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789265627.335298:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0ab0540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265627.335316:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417613696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265627.335703:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417613824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265627.335806:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.336314:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0ab0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265627.340518:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417613824 00000100:00100000:3.0:1789265627.340808:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417613824 00000100:00100000:3.0:1789265627.340920:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789265627.340931:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+18:23491:x1876180417613824:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265627.341176:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+18:23491:x1876180417613824:12345-0@lo:503:mount.lustre.0 Request processed in 246us (5369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265627.341184:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789265627.343800:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417613824:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789265627.344241:0:23491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265627.344316:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417613952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265627.345874:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.345921:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417613952 00000100:00100000:2.0:1789265627.345929:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417613952 00000100:00100000:2.0:1789265627.345992:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789265627.346002:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+18:23491:x1876180417613952:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265627.346125:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+18:23491:x1876180417613952:12345-0@lo:502:mount.lustre.0 Request processed in 124us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265627.346133:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789265627.346697:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0ab0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265627.346719:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417613952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265627.347264:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1789265627.347296:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1789265627.347311:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1789265627.347325:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1789265627.347338:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1789265627.347818:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1789265627.347842:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1789265627.347854:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1789265627.347866:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1789265627.347878:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1789265627.347891:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1789265627.347903:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1789265627.347914:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1789265627.347925:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1789265627.347936:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1789265627.347947:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1789265627.347958:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1789265627.347993:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1789265627.348010:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1789265627.348041:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1789265627.348058:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1789265627.348071:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1789265627.348082:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1789265627.348095:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1789265627.348108:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1789265627.348121:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1789265627.348132:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1789265627.349267:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1789265627.349288:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1789265627.349301:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1789265627.349314:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1789265627.349327:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1789265627.349340:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1789265627.349720:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1789265627.349731:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1789265627.349738:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1789265627.350238:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1789265627.350258:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1789265627.350273:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1789265627.350299:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1789265627.350313:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1789265627.350326:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1789265627.350340:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1789265627.350478:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1789265627.350500:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1789265627.350511:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1789265627.350585:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1789265627.350608:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1789265627.350844:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417614080:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265627.350915:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.350956:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417614080 00000100:00100000:2.0:1789265627.350962:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417614080 00000100:00100000:2.0:1789265627.351015:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789265627.351043:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+18:23491:x1876180417614080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265627.351210:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+18:23491:x1876180417614080:12345-0@lo:502:mount.lustre.0 Request processed in 186us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265627.351218:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789265627.351266:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0ab0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789265627.351285:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417614080:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265627.356612:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1789265627.356683:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1789265627.356731:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417614208:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265627.356920:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.356968:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0ab0900 going to sleep for 11 seconds 00000100:00100000:3.0:1789265627.357052:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417614208 00000100:00100000:3.0:1789265627.357059:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417614208 00000100:00100000:3.0:1789265627.357108:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789265627.357117:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+18:23491:x1876180417614208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265627.357238:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+18:23491:x1876180417614208:12345-0@lo:502:mount.lustre.0 Request processed in 122us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265627.357246:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789265627.357472:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417614208:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265627.357522:0:23491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1789265627.357545:0:23491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789265627.358603:0:23510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789265627.358617:0:23510:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9fcb829f8000) 00000020:00000080:2.0:1789265627.358636:0:23510:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789265627.358857:0:23510:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fccb092a000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789265627.358861:0:23510:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fccb092a000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789265627.358864:0:23510:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fccb092a000 3 00010000:00080000:2.0:1789265627.358890:0:23510:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fccb5c02800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.149@tcp at head 00010000:00010000:2.0:1789265627.362046:0:23510:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1789265627.362953:0:23510:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789265627.363006:0:23510:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789265627.363019:0:23510:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x9272d942b4a98185 00000100:00080000:2.0:1789265627.363055:0:23510:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265627.363061:0:23510:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9fccb5c02800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265627.363094:0:23510:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83c99880 x1876180417614336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265627.363120:0:23510:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789265627.363214:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265627.363219:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265627.363222:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265627.363225:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789265627.363457:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876180417614336:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789265627.363522:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.364015:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417614336 00000100:00100000:2.0:1789265627.364049:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417614336 00000100:00100000:2.0:1789265627.364084:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265627.364091:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876180417614336:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789265627.364112:0:22761:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:2.0:1789265627.364222:0:22761:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x9272d942b4a9818c 00000004:00100000:2.0:1789265627.364241:0:22761:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789265627.364270:0:22761:0:(import.c:65:import_set_state_nolock()) ffff9fccbf448800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265627.364331:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876180417614336:12345-0@lo:38:llog_process_th.0 Request processed in 238us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265627.364339:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1789265627.364715:0:23510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1789265627.364903:0:23491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789265627.364933:0:23491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789265627.364953:0:23491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53e00/0x9272d942b4a98170 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98177 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265627.364964:0:23491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53e00/0x9272d942b4a98170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98177 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789265627.365018:0:23491:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789265627.365041:0:23491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789265627.365043:0:23491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265627.365044:0:23491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265627.365050:0:23491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265627.365052:0:23491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265627.365053:0:23491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265627.365054:0:23491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265627.365056:0:23491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789265627.365059:0:23491:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1789265627.365062:0:23491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265627.365063:0:23491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789265627.365064:0:23491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265627.365065:0:23491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265627.365066:0:23491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265627.365067:0:23491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265627.365068:0:23491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265627.365069:0:23491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265627.365070:0:23491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789265627.365086:0:23491:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789265627.365099:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417614464:0@lo:253:mount.lustre.0 00010000:00080000:1.0:1789265627.365101:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fcb83c99880 x1876180417614336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265627.365110:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265627.365117:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789265627.365123:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789265627.365127:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789265627.365130:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccb5c02800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789265627.365136:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876180417614336:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789265627.365472:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265627.365507:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3b6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789265627.365605:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417614464 00000100:00100000:2.0:1789265627.365610:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417614464 00000100:00100000:2.0:1789265627.366580:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789265627.366593:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+18:23491:x1876180417614464:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789265627.366616:0:22754:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789265627.366627:0:22754:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1789265627.371574:0:22739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789265627.371628:0:22754:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789265627.371694:0:22754:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1789265627.372150:0:22775:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789265627.372156:0:22775:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789265627.372176:0:22775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fccbd2ffc00/0x9272d942b4a98193 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.372194:0:22775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a98097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a98090 expref: 18 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.372202:0:22775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb84a2f600/0x9272d942b4a9815b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a98154 expref: 18 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.372210:0:22775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fccbd2ffc00/0x9272d942b4a98193 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.372245:0:22775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb84a2f600/0x9272d942b4a9815b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a98154 expref: 18 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.372259:0:22775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb84a2f600/0x9272d942b4a9815b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a98154 expref: 18 pid: 22754 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265627.372280:0:22775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22775:1876180417614592:0@lo:104: 00000100:00100000:1.0:1789265627.372341:0:22775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265627.372559:0:22775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a98097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a98090 expref: 18 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.372568:0:22775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a98097 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a98090 expref: 18 pid: 22754 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265627.372578:0:22775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22775:1876180417614720:0@lo:104: 00000100:00100000:1.0:1789265627.372595:0:22775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265627.372612:0:22775:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cf9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265627.372633:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417614592 00000100:00100000:2.0:1789265627.372641:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417614592 00000100:00100000:2.0:1789265627.372676:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417614720 00000100:00100000:2.0:1789265627.372679:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417614720 00000100:00100000:2.0:1789265627.372692:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265627.372699:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82fe313a-a4f8-4781-be1f-82c20160e337+4:22775:x1876180417614592:12345-0@lo:104: 00010000:00010000:2.0:1789265627.372711:0:22742:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a98154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9815b expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265627.372779:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+18:23491:x1876180417614464:12345-0@lo:253:mount.lustre.0 Request processed in 6189us (7640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265627.372788:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1789265627.372803:0:22742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265627.372808:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82fe313a-a4f8-4781-be1f-82c20160e337+4:22775:x1876180417614592:12345-0@lo:104: Request processed in 109us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265627.372814:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265627.372826:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265627.372832:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82fe313a-a4f8-4781-be1f-82c20160e337+3:22775:x1876180417614720:12345-0@lo:104: 00000100:00100000:3.0:1789265627.372838:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:23491:1876180417614464:0@lo:253:mount.lustre.0 00010000:00010000:2.0:1789265627.372846:0:22742:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a98090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a98097 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265627.372849:0:23491:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789265627.372852:0:23491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265627.372854:0:23491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789265627.372855:0:23491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265627.372856:0:23491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265627.372857:0:23491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265627.372859:0:23491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265627.372860:0:23491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789265627.372862:0:23491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265627.372863:0:23491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789265627.372877:0:23491:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789265627.372877:0:22742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265627.372882:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82fe313a-a4f8-4781-be1f-82c20160e337+3:22775:x1876180417614720:12345-0@lo:104: Request processed in 50us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265627.372888:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789265627.372902:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265627.372908:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a98154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a9815b expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.372914:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e800 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265627.372918:0:22748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a98154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a9815b expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.372926:0:22748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a98154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a9815b expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265627.372933:0:22748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a98154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a9815b expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265627.372938:0:22748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265627.372962:0:22748:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a98154 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9815b expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.372967:0:22748:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265627.373001:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a98154 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9815b expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373008:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a98154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a9815b expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373050:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265627.373053:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a98090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a98097 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373059:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f400 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265627.373062:0:22748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a98090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a98097 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373069:0:22748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a98090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a98097 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265627.373075:0:22748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a98090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a98097 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265627.373080:0:22748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265627.373093:0:22748:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a98090 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98097 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373098:0:22748:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265627.373105:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a98090 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98097 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373111:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a98090 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98097 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373121:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265627.373123:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265627.373125:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265627.373131:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265627.373147:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417614848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265627.373173:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.373194:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265627.373199:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417614976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265627.373216:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.373480:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417614848 00000100:00100000:2.0:1789265627.373485:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417614848 00010000:00010000:2.0:1789265627.373503:0:22744:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb84a2f600/0x9272d942b4a9815b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a98154 expref: 18 pid: 22754 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265627.373523:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417614976 00000100:00100000:2.0:1789265627.373639:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417614976 00010000:00010000:2.0:1789265627.373652:0:22744:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a98097 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a98090 expref: 19 pid: 22754 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265627.373666:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265627.373672:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82fe313a-a4f8-4781-be1f-82c20160e337+19:3641:x1876180417614848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265627.373681:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265627.373686:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb84a2f600/0x9272d942b4a9815b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a98154 expref: 19 pid: 22754 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373695:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb84a2f600/0x9272d942b4a9815b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a98154 expref: 19 pid: 22754 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373709:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265627.373736:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82fe313a-a4f8-4781-be1f-82c20160e337+19:3641:x1876180417614848:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265627.373741:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265627.373753:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265627.373759:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82fe313a-a4f8-4781-be1f-82c20160e337+18:3641:x1876180417614976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265627.373772:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265627.373776:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a98097 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a98090 expref: 18 pid: 22754 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373784:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a98097 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a98090 expref: 18 pid: 22754 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373795:0:22744:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fccbd2ffc00/0x9272d942b4a98193 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373802:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2ffc00/0x9272d942b4a98193 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789265627.373814:0:22744:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002394886s 00010000:00010000:2.0:1789265627.373819:0:22744:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fccbd2ffc00/0x9272d942b4a98193 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373826:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fccbd2ffc00/0x9272d942b4a98193 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373832:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fccbd2ffc00/0x9272d942b4a98193 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373840:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fccbd2ffc00/0x9272d942b4a98193 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373846:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffc00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265627.373850:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fccbd2ffc00/0x9272d942b4a98193 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373857:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fccbd2ffc00/0x9272d942b4a98193 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373872:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fccbd2ffc00/0x9272d942b4a98193 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265627.373881:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265627.373903:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82fe313a-a4f8-4781-be1f-82c20160e337+18:3641:x1876180417614976:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265627.373915:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789265627.373952:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417614976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265627.373960:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417614848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265627.374075:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb84a2f600/0x9272d942b4a9815b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a98154 expref: 17 pid: 22754 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265627.374085:0:22775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22775:1876180417614592:0@lo:104: 00010000:00010000:1.0:1789265627.374094:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a98097 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a98090 expref: 16 pid: 22754 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265627.374100:0:22775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22775:1876180417614720:0@lo:104: 00010000:00010000:1.0:1789265627.374113:0:22775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fccbd2ffc00/0x9272d942b4a98193 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.374120:0:22775:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fccbd2ffc00/0x9272d942b4a98193 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.374126:0:22775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fccbd2ffc00/0x9272d942b4a98193 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265627.374142:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2ffc00/0x9272d942b4a98193 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1789265627.383784:0:23491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1789265627.383919:0:23515:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789265627.383923:0:23515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789265627.384317:0:23516:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789265627.384579:0:23491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1789265627.384970:0:23517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23517:1876180417615104:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789265627.385107:0:23517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265627.385149:0:23517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b75c00 going to sleep for 11 seconds 00000040:01000000:1.0:1789265627.385423:0:23491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789265627.385466:0:23491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789265627.386106:0:23491:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789265627.386114:0:23491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789265627.386230:0:23491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265627.386597:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417615104 00000100:00100000:0.0:1789265627.386606:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417615104 00000100:00100000:0.0:1789265627.386658:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265627.386668:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23517:x1876180417615104:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789265627.386866:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23517:x1876180417615104:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 199us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265627.386874:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265627.386930:0:23517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23517:1876180417615104:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789265627.386961:0:23517:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789265627.387003:0:23517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d45c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23517:1876180417615232:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789265627.387056:0:23517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265627.387076:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417615232 00000100:00100000:0.0:1789265627.387080:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417615232 00000100:00100000:0.0:1789265627.387098:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265627.387104:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23517:x1876180417615232:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789265627.387968:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23517:x1876180417615232:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 861us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265627.387978:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789265627.388012:0:23517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265627.388049:0:23517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d45c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23517:1876180417615232:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789265627.388106:0:23517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d45c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23517:1876180417615360:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789265627.388271:0:23517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265627.388310:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417615360 00000100:00100000:0.0:1789265627.388314:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417615360 00000100:00100000:0.0:1789265627.388394:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265627.388403:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23517:x1876180417615360:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789265627.388517:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23517:x1876180417615360:12345-0@lo:900:lod0001_rec0000.0 Request processed in 115us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265627.388524:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265627.388543:0:23517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4180 going to sleep for 11 seconds 00010000:00080000:0.0:1789265627.388559:0:23517:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fcb83d45c00 x1876180417615360/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789265643 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265627.388583:0:23517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d45c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23517:1876180417615360:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789265627.388624:0:23517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d45c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23517:1876180417615488:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1789265627.389264:0:23516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265627.392300:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789265627.392400:0:23516:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1789265627.393522:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00000040:00080000:1.0:1789265627.394246:0:23491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1789265627.394796:0:23517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265627.394831:0:23517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265627.394873:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417615488 00000100:00100000:0.0:1789265627.394881:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417615488 00000100:00100000:0.0:1789265627.395061:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789265627.395071:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23517:x1876180417615488:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789265627.395262:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23517:x1876180417615488:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 193us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265627.395270:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265627.395463:0:23517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d45c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23517:1876180417615488:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1789265627.395526:0:23517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265627.397627:0:23491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789265627.400951:0:23491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789265627.401958:0:23491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789265627.404834:0:23491:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:2.0:1789265627.405618:0:23517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789265627.406316:0:23517:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789265627.406322:0:23517:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:1.0:1789265627.408998:0:23491:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1789265627.411921:0:23491:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789265627.411958:0:23491:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbf45c5557988 00100000:10000000:1.0:1789265627.411967:0:23491:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789265627.413426:0:23491:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789265627.413465:0:23491:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.149@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789265627.413484:0:23491:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789265627.413504:0:23491:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789265627.417865:0:23491:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265627.419120:0:23491:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789265628.040779:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265628.417469:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00000040:00080000:0.0:1789265628.418847:0:23512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1789265628.801085:0:22757:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789265628.801093:0:22757:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fccb092a000 from 12 10000000:01000000:2.0:1789265628.801099:0:22757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789265628.801139:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a9819a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265628.801160:0:22757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a9819a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265628.801172:0:22757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a9819a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265628.801196:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417615616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265628.801326:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265628.801373:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0ab06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265628.802411:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417615616 00000100:00100000:3.0:1789265628.802421:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417615616 00000100:00100000:3.0:1789265628.802530:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789265628.802539:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+16:22757:x1876180417615616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265628.802553:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265628.802567:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a981a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9819a expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265628.802591:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a981a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9819a expref: 17 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265628.802602:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a981a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9819a expref: 17 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265628.802610:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f52400, rc 0) 00000100:00100000:3.0:1789265628.804060:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+17:22757:x1876180417615616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1514us (2726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265628.804071:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789265628.805353:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417615616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265628.805377:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a9819a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a981a1 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265628.805390:0:22757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a9819a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a981a1 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265628.805450:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d45f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417615744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789265628.805501:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265628.805535:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada67300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265628.807368:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417615744 00000100:00100000:3.0:1789265628.807379:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417615744 00000100:00100000:3.0:1789265628.807615:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789265628.807628:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+17:22757:x1876180417615744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789265628.807660:0:22754:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789265628.807676:0:22754:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789265628.807680:0:22754:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1789265628.807793:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+17:22757:x1876180417615744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 168us (2290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265628.807801:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789265628.807958:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d45f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417615744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789265628.808047:0:22757:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265628.808057:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a9819a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a981a1 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265628.808078:0:22757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a9819a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a981a1 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265628.808089:0:22757:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265628.808091:0:22757:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fccbc1ce800 from 12 10000000:01000000:0.0:1789265628.808094:0:22757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265628.808118:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4600/0x9272d942b4a981a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265628.808126:0:22757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4600/0x9272d942b4a981a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265628.808136:0:22757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4600/0x9272d942b4a981a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265628.808152:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d45f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417615872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265628.808185:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265628.808213:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada67300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265628.808411:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417615872 00000100:00100000:3.0:1789265628.808417:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417615872 00000100:00100000:3.0:1789265628.809194:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789265628.809206:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+17:22757:x1876180417615872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265628.809218:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265628.809232:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f53a00/0x9272d942b4a981af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a981a8 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265628.809253:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f53a00/0x9272d942b4a981af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a981a8 expref: 18 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265628.809264:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f53a00/0x9272d942b4a981af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a981a8 expref: 18 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265628.809575:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f53a00, rc 0) 00000100:00100000:3.0:1789265628.809648:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+18:22757:x1876180417615872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 445us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265628.809654:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789265628.809917:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d45f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417615872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265628.809934:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4600/0x9272d942b4a981a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a981af expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265628.809944:0:22757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4600/0x9272d942b4a981a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a981af expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265628.810005:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d45f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417616000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789265628.810057:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265628.810088:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada67300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265628.810225:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417616000 00000100:00100000:3.0:1789265628.810230:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417616000 00000100:00100000:3.0:1789265628.810263:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789265628.810270:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+18:22757:x1876180417616000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789265628.810292:0:22753:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789265628.810613:0:22753:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789265628.810617:0:22753:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1789265628.810705:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+18:22757:x1876180417616000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 434us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265628.810713:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789265628.810716:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d45f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417616000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789265628.810764:0:22757:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265628.810770:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4600/0x9272d942b4a981a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a981af expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265628.810778:0:22757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4600/0x9272d942b4a981a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a981af expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265629.057298:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265629.441154:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00000040:00080000:1.0:1789265629.445210:0:23512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789265630.086317:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265630.466059:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00010000:00010000:3.0:1789265631.107590:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265631.493523:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00010000:00010000:2.0:1789265632.129367:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265632.194781:0:23760:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789265632.517472:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 0 seconds 00000100:00080000:3.0:1789265632.771408:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789265632.771414:0:14028:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789265632.771418:0:14028:0:(import.c:65:import_set_state_nolock()) ffff9fcb83e09000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265632.771429:0:14028:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fcb83e09000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:3.0:1789265632.771450:0:14028:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb8495d880 x1876180417616256/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265632.771470:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265632.771474:0:14028:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265632.771477:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265632.771480:0:14028:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265632.771501:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265632.771504:0:14028:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265632.771506:0:14028:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265632.771509:0:14028:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789265632.771551:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417616256:0@lo:38:kworker.0 00000100:00100000:3.0:1789265632.771625:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265632.771673:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417616256 00000100:00100000:3.0:1789265632.771679:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417616256 00000100:00100000:3.0:1789265632.771712:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265632.771719:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876180417616256:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789265632.771757:0:22765:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:3.0:1789265632.771791:0:22765:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a981b6 00000004:00100000:3.0:1789265632.771805:0:22765:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789265632.771810:0:22765:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1789265632.772056:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82fe313a-a4f8-4781-be1f-82c20160e337:3643:1876180417616128:0@lo:400:kworker.0 00000100:00100000:0.0:1789265632.772094:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265632.772122:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265632.772128:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417616384:0@lo:400:kworker.0 00000100:00100000:0.0:1789265632.772151:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265632.772178:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417616384 00000100:00100000:0.0:1789265632.772181:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417616384 00000100:00100000:0.0:1789265632.772211:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265632.772217:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417616384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265632.772264:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417616384:12345-0@lo:400:kworker.0 Request processed in 47us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265632.772271:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789265632.772305:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb8495f100 x1876180417616384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265632.772318:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417616384:0@lo:400:kworker.0 00000100:00100000:3.0:1789265632.772522:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417616128 00000100:00100000:3.0:1789265632.772526:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417616128 00000100:00100000:3.0:1789265632.772566:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789265632.772573:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+18:3643:x1876180417616128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265632.772606:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+18:3643:x1876180417616128:12345-0@lo:400:kworker.0 Request processed in 34us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265632.772612:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789265632.772866:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417616768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265632.772894:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265632.772939:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82fe313a-a4f8-4781-be1f-82c20160e337:3643:1876180417616128:0@lo:400:kworker.0 00000100:00100000:3.0:1789265632.773016:0:22764:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789265632.773052:0:22764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789265632.773127:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417616512:0@lo:400:kworker.0 00000100:00100000:2.0:1789265632.773155:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265632.773170:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265632.773176:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417616640:0@lo:400:kworker.0 00000100:00100000:2.0:1789265632.773201:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265632.773525:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417616640 00000100:00100000:3.0:1789265632.773530:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417616640 00000100:00100000:3.0:1789265632.773578:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265632.773586:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417616640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265632.773628:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417616640:12345-0@lo:400:kworker.0 Request processed in 43us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265632.773635:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789265632.773665:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb8495ea00 x1876180417616640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265632.773688:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417616640:0@lo:400:kworker.0 00000100:00100000:0.0:1789265632.773907:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417616768 00000100:00100000:0.0:1789265632.773912:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417616768 00000100:00100000:0.0:1789265632.773935:0:22764:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1789265632.773941:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417616512 00000100:00100000:0.0:1789265632.773943:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417616512 00000100:00100000:2.0:1789265632.774118:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265632.774127:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1876180417616768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265632.774151:0:23784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789265632.774193:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1876180417616768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265632.774199:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265632.774214:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789265632.774227:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417616512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265632.774276:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417616512:12345-0@lo:400:kworker.0 Request processed in 50us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265632.774283:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265632.774410:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417616768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265632.774754:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417616512:0@lo:400:kworker.0 00000100:00080000:0.0:1789265632.778962:0:22765:0:(import.c:65:import_set_state_nolock()) ffff9fcca78d3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265632.779097:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1876180417616256:12345-0@lo:38:kworker.0 Request processed in 7374us (7468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265632.779107:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789265632.779321:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789265632.779330:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789265632.779335:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789265632.779338:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb83e09000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789265632.779360:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000512ab7c2): req@ffff9fcb83c99c00 x1876180417609344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265632.779380:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417616256:0@lo:38:kworker.0 00000100:00100000:3.0:1789265632.779445:0:22801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265632.779471:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd342300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265632.779487:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417609344 00000100:00100000:3.0:1789265632.779493:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417609344 00000100:00100000:3.0:1789265632.779527:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265632.779547:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22801:x1876180417609344:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789265632.779616:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22801:x1876180417609344:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 81us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265632.779624:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265632.779649:0:22801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22801:1876180417609344:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1789265632.779680:0:22801:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789265632.779718:0:22801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22801:1876180417616896:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789265632.779760:0:22801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265632.779777:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b756c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265632.779792:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417616896 00000100:00100000:3.0:1789265632.779809:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417616896 00000100:00100000:3.0:1789265632.779832:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265632.779838:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22801:x1876180417616896:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789265632.779932:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22801:x1876180417616896:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 93us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265632.779939:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265632.779977:0:22801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22801:1876180417616896:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789265632.780087:0:22801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22801:1876180417617024:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789265632.780112:0:22801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265632.780126:0:22801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82b756c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265632.780138:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417617024 00000100:00100000:3.0:1789265632.780141:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417617024 00000100:00100000:3.0:1789265632.780159:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265632.780165:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22801:x1876180417617024:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789265632.780210:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22801:x1876180417617024:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 45us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265632.780216:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789265632.780242:0:22801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22801:1876180417617024:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1789265632.780280:0:22801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265632.782243:0:22801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789265632.782327:0:22801:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:3.0:1789265632.782332:0:22801:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1789265632.783163:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417617152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265632.783231:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265632.783602:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417617152 00000100:00100000:2.0:1789265632.783612:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417617152 00000100:00100000:2.0:1789265632.783660:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789265632.783682:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180417617152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265632.783717:0:23784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789265632.783781:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180417617152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265632.783788:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265632.784073:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417617152:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789265633.153803:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789265633.348987:0:23813:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265633.349235:0:23813:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789265634.180861:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789265634.339767:0:23863:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789265634.339968:0:23863:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789265635.204367:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789265635.782852:0:23911:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1c7efff0 20000000:00000080:2.0:1789265635.782895:0:23911:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fcc987bb800 uarg=0000000000000000 20000000:01000000:2.0:1789265635.782989:0:23911:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789265635.783000:0:23911:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789265635.783007:0:23911:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789265635.784947:0:23912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1789265635.785484:0:23911:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789265635.809973:0:23911:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789265635.810814:0:23911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a981bd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265635.810862:0:23911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98066 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9805f expref: 17 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265635.810884:0:23911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a98169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a98162 expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265635.810893:0:23911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a981bd lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265635.810962:0:23911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a98169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a98162 expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265635.810981:0:23911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a98169 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a98162 expref: 17 pid: 22753 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265635.811001:0:23911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23911:1876180417617280:0@lo:104: 00000100:00100000:1.0:1789265635.811132:0:23911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265635.811220:0:23911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a9805f expref: 17 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265635.811231:0:23911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98066 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a9805f expref: 17 pid: 22754 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265635.811252:0:23911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23911:1876180417617408:0@lo:104: 00000100:00100000:1.0:1789265635.811276:0:23911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265635.811304:0:23911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0ab06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265635.811659:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417617280 00000100:00100000:0.0:1789265635.811669:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417617280 00000100:00100000:0.0:1789265635.811717:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417617408 00000100:00100000:0.0:1789265635.811720:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417617408 00000100:00100000:0.0:1789265635.811736:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265635.811746:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:82fe313a-a4f8-4781-be1f-82c20160e337+4:23911:x1876180417617280:12345-0@lo:104: 00010000:00010000:0.0:1789265635.811762:0:22743:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ea00/0x9272d942b4a98162 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a98169 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265635.811853:0:22743:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265635.811860:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:82fe313a-a4f8-4781-be1f-82c20160e337+4:23911:x1876180417617280:12345-0@lo:104: Request processed in 115us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265635.811878:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265635.811899:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265635.811906:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:82fe313a-a4f8-4781-be1f-82c20160e337+3:23911:x1876180417617408:12345-0@lo:104: 00010000:00010000:0.0:1789265635.811914:0:22743:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a9805f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a98066 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265635.811964:0:22743:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789265635.811970:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:82fe313a-a4f8-4781-be1f-82c20160e337+3:23911:x1876180417617408:12345-0@lo:104: Request processed in 65us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265635.811976:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789265635.811997:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265635.812004:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ea00/0x9272d942b4a98162 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a98169 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265635.812012:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2ea00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:0.0:1789265635.812017:0:22747:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ea00/0x9272d942b4a98162 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a98169 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265635.812056:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ea00/0x9272d942b4a98162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a98169 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265635.812065:0:22747:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ea00/0x9272d942b4a98162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a98169 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265635.812071:0:22747:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265635.812114:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ea00/0x9272d942b4a98162 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98169 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265635.812121:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265635.812145:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ea00/0x9272d942b4a98162 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98169 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265635.812153:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ea00/0x9272d942b4a98162 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98169 expref: -99 pid: 23491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265635.812168:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265635.812171:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a9805f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a98066 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265635.812177:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4a00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:0.0:1789265635.812181:0:22747:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a9805f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a98066 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265635.812188:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a9805f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a98066 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265635.812195:0:22747:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a9805f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a98066 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265635.812201:0:22747:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265635.812213:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a9805f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98066 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265635.812219:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265635.812225:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a9805f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98066 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265635.812242:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4a00/0x9272d942b4a9805f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98066 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265635.812257:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265635.812259:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265635.812261:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265635.812285:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82fe313a-a4f8-4781-be1f-82c20160e337:3642:1876180417617664:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265635.813792:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265635.813997:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417617536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265635.814801:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265635.815416:0:23911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23911:1876180417617280:0@lo:104: 00000100:00100000:1.0:1789265635.815433:0:23911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23911:1876180417617408:0@lo:104: 00010000:00010000:1.0:1789265635.815754:0:23911:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a981bd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265635.816010:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417617664 00000100:00100000:3.0:1789265635.816416:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417617664 00010000:00010000:3.0:1789265635.816685:0:22745:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98066 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9805f expref: 18 pid: 22754 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265635.817317:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265635.817342:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82fe313a-a4f8-4781-be1f-82c20160e337+18:3642:x1876180417617664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265635.817363:0:22745:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265635.817371:0:22745:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98066 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9805f expref: 18 pid: 22754 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265635.817384:0:22745:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a9805f expref: 18 pid: 22754 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265635.817406:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98066 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a9805f expref: 18 pid: 22754 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265635.817425:0:22745:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265635.817526:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82fe313a-a4f8-4781-be1f-82c20160e337+17:3642:x1876180417617664:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (2728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265635.817534:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789265635.822185:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82fe313a-a4f8-4781-be1f-82c20160e337:3642:1876180417617664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265635.822607:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265635.825290:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417617536 00000100:00100000:2.0:1789265635.825311:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417617536 00010000:00010000:2.0:1789265635.825380:0:22744:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a98169 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a98162 expref: 17 pid: 22753 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265635.825476:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265635.825488:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82fe313a-a4f8-4781-be1f-82c20160e337+17:3641:x1876180417617536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265635.825508:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265635.825515:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a98169 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a98162 expref: 17 pid: 22753 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265635.825530:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a98169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a98162 expref: 17 pid: 22753 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265635.825553:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2fec00/0x9272d942b4a98169 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a98162 expref: 17 pid: 22753 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265635.825575:0:22744:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a981bd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265635.825584:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a981bd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265635.825604:0:22744:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a981bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265635.825612:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a981bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265635.825619:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a981bd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265635.825626:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a981bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265635.825643:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265635.825648:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a981bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265635.825656:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a981bd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265635.825672:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a981bd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265635.825684:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265635.825788:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82fe313a-a4f8-4781-be1f-82c20160e337+16:3641:x1876180417617536:12345-0@lo:103:ldlm_bl.0 Request processed in 302us (3181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265635.825797:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265635.826163:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417617536:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265635.826599:0:23911:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a981bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265635.826612:0:23911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a981bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265635.826620:0:23911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a981bd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265636.225398:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265636.547540:0:22793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789265637.249438:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789265637.569251:0:22757:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265637.569261:0:22757:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccb092a000 from 13 10000000:01000000:2.0:1789265637.569266:0:22757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265637.569329:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a981c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265637.569343:0:22757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a981c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265637.569359:0:22757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a981c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265637.569394:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417617792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265637.580141:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265637.581164:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83275780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265637.581298:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417617792 00000100:00100000:0.0:1789265637.581313:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417617792 00000100:00100000:0.0:1789265637.581388:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789265637.581399:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+16:22757:x1876180417617792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265637.581420:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265637.581450:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83da5400/0x9272d942b4a981cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a981c4 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265637.582323:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83da5400/0x9272d942b4a981cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a981c4 expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265637.582337:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83da5400/0x9272d942b4a981cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a981c4 expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265637.582348:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5400, rc 0) 00000100:00100000:0.0:1789265637.582443:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+17:22757:x1876180417617792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1045us (2315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265637.583082:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789265637.583434:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417617792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265637.583475:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a981c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a981cb expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265637.583490:0:22757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a981c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a981cb expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265637.583603:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417617920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265637.583663:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265637.583711:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83275780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265637.583830:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417617920 00000100:00100000:0.0:1789265637.583839:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417617920 00000100:00100000:0.0:1789265637.583879:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789265637.583888:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+17:22757:x1876180417617920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265637.584501:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+17:22757:x1876180417617920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 613us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265637.584510:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789265637.587149:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417617920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265637.587250:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417618048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265637.587368:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265637.587420:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83275780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265637.587714:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417618048 00000100:00100000:0.0:1789265637.587722:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417618048 00000100:00100000:0.0:1789265637.587778:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789265637.587789:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+17:22757:x1876180417618048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265637.587963:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+17:22757:x1876180417618048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265637.587971:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789265637.588336:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417618048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789265637.589849:0:23980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789265637.594630:0:22757:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789265637.594685:0:22757:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265637.594700:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a981c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a981cb expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265637.594716:0:22757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a981c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a981cb expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265637.594729:0:22757:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265637.594732:0:22757:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccbc1ce800 from 13 10000000:01000000:0.0:1789265637.594736:0:22757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265637.594789:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a981d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265637.594818:0:22757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a981d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265637.594834:0:22757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a981d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265637.594866:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417618176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265637.595114:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265637.595212:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3ea300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265637.595941:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417618176 00000100:00100000:3.0:1789265637.595953:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417618176 00000100:00100000:3.0:1789265637.596408:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789265637.596420:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+17:22757:x1876180417618176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265637.596441:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265637.596472:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f52200/0x9272d942b4a981d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a981d2 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265637.596510:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f52200/0x9272d942b4a981d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a981d2 expref: 18 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265637.596540:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f52200/0x9272d942b4a981d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a981d2 expref: 18 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265637.596551:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f52200, rc 0) 00000100:00100000:3.0:1789265637.596641:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+18:22757:x1876180417618176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265637.596649:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789265637.596757:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417618176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265637.596778:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a981d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a981d9 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265637.596788:0:22757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a981d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a981d9 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265637.596881:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417618304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265637.596940:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265637.597694:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83275540 going to sleep for 11 seconds 00000100:00100000:0.0:1789265637.597824:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417618304 00000100:00100000:0.0:1789265637.597833:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417618304 00000100:00100000:0.0:1789265637.597876:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789265637.597886:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+18:22757:x1876180417618304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265637.598430:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+18:22757:x1876180417618304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 544us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265637.598439:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789265637.598640:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417618304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265637.598696:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417618432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265637.598757:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265637.598790:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83275540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265637.598881:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417618432 00000100:00100000:3.0:1789265637.598887:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417618432 00000100:00100000:3.0:1789265637.598932:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789265637.598941:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+18:22757:x1876180417618432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265637.599085:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+18:22757:x1876180417618432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265637.599093:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789265637.599566:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417618432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789265637.600760:0:23981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789265637.601086:0:22757:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789265637.601116:0:22757:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265637.601132:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a981d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a981d9 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265637.601146:0:22757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a981d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a981d9 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265637.889207:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265637.889227:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417618560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265637.889292:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265637.889411:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417618688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265637.889434:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265637.889533:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417618560 00000100:00100000:3.0:1789265637.889542:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417618560 00000100:00100000:3.0:1789265637.889583:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417618688 00000100:00100000:3.0:1789265637.889596:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417618688 00000100:00100000:3.0:1789265637.889614:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265637.889623:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180417618560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265637.889669:0:22765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265637.889714:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876180417618560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265637.889720:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265637.889736:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789265637.889742:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417618688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265637.889757:0:22765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789265637.889790:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417618688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265637.889796:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265637.890131:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417618688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265637.890145:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417618560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265637.890332:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265627/real 1789265627] req@ffff9fcb83d47800 x1876180417612544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265637 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265637.890352:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83d47800 x1876180417612544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265637 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265637.890362:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265627/real 1789265627] req@ffff9fcb8495ca80 x1876180417612416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265637 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265637.890374:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb8495ca80 x1876180417612416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265637 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789265637.890387:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcca789a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789265637.890394:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789265637.890397:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417612544:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789265637.890402:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcc83e0d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789265637.890405:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789265637.890416:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417612416:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789265637.890667:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265637.890678:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265637.890680:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265637.890682:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265637.890693:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265637.890694:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789265637.890696:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcc83e0d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265637.890700:0:17249:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 678 00000100:00080000:0.0:1789265637.890703:0:17249:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789265637.890707:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fcc83e0d800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265637.890720:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83d44a80 x1876180417619072/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265637.890733:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265637.890735:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789265637.890736:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcca789a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789265637.890738:0:17249:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 678 00000100:00080000:0.0:1789265637.890740:0:17249:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789265637.890742:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fcca789a800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265637.890747:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83d47800 x1876180417619200/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265637.890770:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417619328:0@lo:400:kworker.0 00000100:00100000:0.0:1789265637.890796:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265637.890820:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417619328 00000100:00100000:0.0:1789265637.890822:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417619328 00000100:00100000:0.0:1789265637.890845:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265637.890854:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417619328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265637.890883:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417619328:12345-0@lo:400:kworker.0 Request processed in 30us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265637.890887:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789265637.890910:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fccbf40c000 x1876180417619328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265637.890930:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417619328:0@lo:400:kworker.0 00000100:00100000:2.0:1789265637.890965:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417618816:0@lo:400:kworker.0 00000100:00100000:3.0:1789265637.890979:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417618944:0@lo:400:kworker.0 00000100:00100000:3.0:1789265637.891005:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265637.891009:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265637.891066:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417618816 00000100:00100000:2.0:1789265637.891070:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417618816 00000100:00100000:1.0:1789265637.891091:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417619072:0@lo:8:kworker.0 00000100:00100000:2.0:1789265637.891103:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789265637.891109:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaea74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+18:3641:x1876180417618816:12345-0@lo:400:kworker.0 00000400:00000100:1.0:1789265637.891116:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417619072 offset 0 length 520: 4 00000100:00100000:1.0:1789265637.891134:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417619200:0@lo:8:kworker.0 00000100:00100000:2.0:1789265637.891140:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaea74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+18:3641:x1876180417618816:12345-0@lo:400:kworker.0 Request processed in 32us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265637.891146:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000400:00000100:1.0:1789265637.891148:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417619200 offset 0 length 520: 4 00000100:00100000:2.0:1789265637.891177:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417618816:0@lo:400:kworker.0 00000100:00100000:0.0:1789265637.891277:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417618944 00000100:00100000:0.0:1789265637.891281:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417618944 00000100:00100000:0.0:1789265637.891338:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265637.891345:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417618944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265637.891389:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417618944:12345-0@lo:400:kworker.0 Request processed in 44us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265637.891395:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789265637.891462:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb83d45c00 x1876180417618944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265637.891472:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417618944:0@lo:400:kworker.0 00010000:00010000:3.0:1789265638.273191:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265638.913196:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265623/real 1789265623] req@ffff9fcb8495c380 x1876180417610368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265638 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265638.913227:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb8495c380 x1876180417610368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265638 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265638.913237:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265623/real 1789265623] req@ffff9fcb8495e680 x1876180417610496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265638 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265638.913249:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb8495e680 x1876180417610496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265638 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789265638.913266:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcc82d4e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265638.913284:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789265638.913289:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417610368:0@lo:8:kworker.0 00000100:00080000:1.0:1789265638.913301:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccb4fdb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265638.913307:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789265638.913310:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417610496:0@lo:8:kworker.0 00000100:00080000:2.0:1789265638.914117:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265638.914122:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789265638.914129:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcc82d4e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265638.914134:0:17249:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 674 00000100:00080000:2.0:1789265638.914139:0:17249:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789265638.914146:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fcc82d4e000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265638.914165:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83c99f80 x1876180417619712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265638.914177:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265638.914180:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789265638.914182:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fccb4fdb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265638.914184:0:17249:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 674 00000100:00080000:2.0:1789265638.914186:0:17249:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789265638.914189:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fccb4fdb800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265638.914198:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83c9ad80 x1876180417619840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265638.914216:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265638.914220:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265638.914223:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265638.914226:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789265638.914249:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417619584:0@lo:400:kworker.0 00000100:00100000:2.0:1789265638.914313:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265638.914588:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:82fe313a-a4f8-4781-be1f-82c20160e337:3644:1876180417619456:0@lo:400:kworker.0 00000100:00100000:1.0:1789265638.914621:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265638.914654:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417620224:0@lo:400:kworker.0 00000100:00100000:1.0:1789265638.914675:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265638.914695:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265638.914700:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417620096:0@lo:400:kworker.0 00000100:00100000:1.0:1789265638.914721:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265638.914749:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417619456 00000100:00100000:1.0:1789265638.914756:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417619456 00000100:00100000:1.0:1789265638.914799:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789265638.914808:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaea77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+18:3644:x1876180417619456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265638.914847:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaea77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+18:3644:x1876180417619456:12345-0@lo:400:kworker.0 Request processed in 41us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265638.914854:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789265638.914883:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417620224 00000100:00100000:1.0:1789265638.914886:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417620224 00000100:00100000:1.0:1789265638.914916:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265638.914923:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417620224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265638.914949:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417620224:12345-0@lo:400:kworker.0 Request processed in 27us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265638.914954:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265638.914973:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417619712:0@lo:8:kworker.0 00000400:00000100:1.0:1789265638.914998:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417619712 offset 0 length 520: 4 00000100:00100000:1.0:1789265638.915009:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417619840:0@lo:8:kworker.0 00000400:00000100:1.0:1789265638.915035:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876180417619840 offset 0 length 520: 4 00000100:00100000:1.0:1789265638.915071:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:82fe313a-a4f8-4781-be1f-82c20160e337:3644:1876180417619456:0@lo:400:kworker.0 00010000:00080000:1.0:1789265638.915081:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb83c99c00 x1876180417620224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265638.915091:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417620224:0@lo:400:kworker.0 00000100:00100000:3.0:1789265638.915320:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417619584 00000100:00100000:3.0:1789265638.915324:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417619584 00000100:00100000:3.0:1789265638.915410:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417620096 00000100:00100000:3.0:1789265638.915414:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417620096 00000100:00100000:3.0:1789265638.915428:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265638.915434:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876180417619584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265638.916828:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876180417619584:12345-0@lo:400:kworker.0 Request processed in 1388us (2510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265638.916838:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789265638.916863:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789265638.916874:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417620096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265638.916942:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417620096:12345-0@lo:400:kworker.0 Request processed in 72us (2220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265638.916948:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789265638.917555:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417620096:0@lo:400:kworker.0 00000100:00100000:2.0:1789265638.921352:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417619584:0@lo:400:kworker.0 00000100:00100000:2.0:1789265638.921385:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265638.921397:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417619968:0@lo:400:kworker.0 00000100:00100000:2.0:1789265638.921463:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265638.921574:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417619968 00000100:00100000:3.0:1789265638.921581:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417619968 00000100:00100000:3.0:1789265638.921628:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789265638.921638:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417619968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265638.921880:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417619968:12345-0@lo:400:kworker.0 Request processed in 241us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265638.921887:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789265638.921950:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb83c9b100 x1876180417619968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265638.921962:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417619968:0@lo:400:kworker.0 00000001:00100000:2.0:1789265638.924059:0:23492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789265639.299121:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265639.683304:0:23512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789265640.322816:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265641.345125:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789265642.275775:0:24259:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789265642.275778:0:24259:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789265642.275780:0:24259:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789265642.276361:0:24259:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fcb821f0000 00000020:01000004:1.0:1789265642.276377:0:24259:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789265642.276389:0:24259:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789265642.276402:0:24259:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fccbc584d28) 00000020:00000080:1.0:1789265642.276416:0:24259:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789265642.358748:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789265642.361838:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789265642.363123:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789265642.363727:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789265642.364673:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789265642.365144:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789265642.366627:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1789265642.367710:0:24259:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789265642.367989:0:24259:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789265642.368002:0:24259:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789265642.368014:0:24259:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9272d942b4a981e7 00000020:01000004:1.0:1789265642.369719:0:24259:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789265642.369751:0:24259:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.149@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789265642.369755:0:24259:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.149@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789265642.369764:0:24259:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789265642.369769:0:24259:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789265642.369784:0:24259:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fccbc5819b8) 00000020:00000080:1.0:1789265642.369800:0:24259:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00010000:00010000:0.0:1789265642.374993:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265642.376652:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789265642.376844:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789265642.376850:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789265642.385647:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789265642.385662:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789265642.386047:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789265642.386055:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789265642.388863:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789265642.389081:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789265642.389088:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789265642.390900:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789265642.390912:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789265642.412364:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265642.414176:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789265642.414185:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789265642.416345:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789265642.416357:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789265642.417797:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789265642.417807:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789265642.420917:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789265642.421155:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789265642.421162:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789265642.421759:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789265642.421766:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789265642.448307:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789265642.448501:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789265642.448507:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789265642.449805:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789265642.449814:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789265642.450398:0:24259:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789265642.450426:0:24259:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789265642.450432:0:24259:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.149@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789265642.476766:0:24259:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.149@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789265642.476815:0:24259:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.149@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789265642.476819:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789265642.476821:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789265642.476823:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265642.476824:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265642.476825:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265642.476827:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265642.476828:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265642.476829:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265642.476831:0:24259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789265642.476834:0:24259:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789265642.476836:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789265642.476837:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789265642.476838:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265642.476839:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265642.476841:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265642.476842:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265642.476843:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265642.476844:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265642.476845:0:24259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789265642.476869:0:24259:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789265642.476899:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417620352:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789265642.476968:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265642.477109:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83e9c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265642.480405:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417620352 00000100:00100000:3.0:1789265642.480418:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417620352 00000100:00100000:2.0:1789265642.480836:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789265642.480848:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc85816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+18:24259:x1876180417620352:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789265642.480999:0:22753:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789265642.481003:0:22753:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789265642.481008:0:22753:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789265642.481779:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc85816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+18:24259:x1876180417620352:12345-0@lo:253:mount.lustre.0 Request processed in 931us (4808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265642.481799:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789265642.481862:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417620352:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789265642.481951:0:24259:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789265642.481956:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789265642.481957:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789265642.481959:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265642.481960:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265642.481961:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265642.481962:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265642.481964:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265642.481966:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265642.481967:0:24259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789265642.481991:0:24259:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fcb821f0000 from lustre-OST0000 10000000:01000000:1.0:1789265642.482060:0:24259:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789265642.482063:0:24259:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789265642.482070:0:24259:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fccb09b3370 local copy 00010000:00010000:1.0:1789265642.482080:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a97fa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fa9 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265642.482180:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417620480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265642.482215:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265642.482254:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc81370300 going to sleep for 11 seconds 00000100:00100000:2.0:1789265642.482383:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417620480 00000100:00100000:2.0:1789265642.482388:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417620480 00000100:00100000:2.0:1789265642.482467:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789265642.482475:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc87ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+18:24259:x1876180417620480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265642.482534:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc87ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+18:24259:x1876180417620480:12345-0@lo:501:mount.lustre.0 Request processed in 61us (319us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265642.482541:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789265642.482649:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417620480:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789265642.482662:0:24259:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.149@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789265642.482677:0:24259:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.149@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789265642.482682:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a97fa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fa9 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265642.482690:0:24259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a97fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fa9 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265642.482734:0:24259:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fcb821f0000 10000000:01000000:1.0:1789265642.482739:0:24259:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789265642.482744:0:24259:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789265642.482746:0:24259:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789265642.482750:0:24259:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789265642.482753:0:24259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789265642.482771:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fee00/0x9272d942b4a981f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265642.482779:0:24259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fee00/0x9272d942b4a981f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265642.482788:0:24259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fee00/0x9272d942b4a981f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265642.482799:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417620608:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265642.482825:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265642.483312:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc81370300 going to sleep for 11 seconds 00000100:00100000:0.0:1789265642.483405:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417620608 00000100:00100000:0.0:1789265642.483410:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417620608 00000100:00100000:2.0:1789265642.483498:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789265642.483506:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+18:24259:x1876180417620608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265642.483514:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265642.483527:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2ec00/0x9272d942b4a981fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a981f5 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.483547:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2ec00/0x9272d942b4a981fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a981f5 expref: 19 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.483677:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb84a2ec00/0x9272d942b4a981fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a981f5 expref: 19 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.483687:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2ec00, rc 0) 00000100:00100000:2.0:1789265642.483834:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+19:24259:x1876180417620608:12345-0@lo:101:mount.lustre.0 Request processed in 328us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265642.483841:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789265642.484155:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417620608:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265642.484169:0:24259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fee00/0x9272d942b4a981f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a981fc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265642.484178:0:24259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fee00/0x9272d942b4a981f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a981fc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265642.488527:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1789265642.489794:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265642.492527:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789265642.492768:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1789265642.492789:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1789265642.492804:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1789265642.492818:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1789265642.492834:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1789265642.492865:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1789265642.492946:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1789265642.492963:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1789265642.492976:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1789265642.492988:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1789265642.493000:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1789265642.493224:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1789265642.493233:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1789265642.493398:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417620736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265642.493528:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265642.493682:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83e9c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789265642.493819:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417620736 00000100:00100000:2.0:1789265642.493826:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417620736 00000100:00100000:2.0:1789265642.493975:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789265642.493994:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+19:24259:x1876180417620736:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265642.494246:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+19:24259:x1876180417620736:12345-0@lo:501:mount.lustre.0 Request processed in 254us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265642.494254:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789265642.494333:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417620736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265642.494369:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417620864:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265642.494411:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265642.494811:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83e9c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265642.494840:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417620864 00000100:00100000:0.0:1789265642.494851:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417620864 00000100:00100000:0.0:1789265642.494875:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789265642.494896:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+19:24259:x1876180417620864:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265642.495866:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+19:24259:x1876180417620864:12345-0@lo:503:mount.lustre.0 Request processed in 982us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265642.495874:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789265642.495977:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417620864:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789265642.496413:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789265642.496496:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417620992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265642.496540:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265642.496578:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc98ed5540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265642.496935:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417620992 00000100:00100000:2.0:1789265642.496942:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417620992 00000100:00100000:2.0:1789265642.496981:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789265642.496991:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+19:24259:x1876180417620992:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265642.500796:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+19:24259:x1876180417620992:12345-0@lo:502:mount.lustre.0 Request processed in 3798us (4247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265642.500811:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789265642.500975:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417620992:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265642.501213:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789265642.501250:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1789265642.501265:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1789265642.501277:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1789265642.501291:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1789265642.501909:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1789265642.501936:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1789265642.501972:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1789265642.501989:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1789265642.502004:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1789265642.502018:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1789265642.502067:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1789265642.502112:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417621120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265642.502167:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265642.502211:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc81370300 going to sleep for 11 seconds 00000100:00100000:3.0:1789265642.502251:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417621120 00000100:00100000:3.0:1789265642.502259:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417621120 00000100:00100000:3.0:1789265642.502309:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789265642.502319:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+19:24259:x1876180417621120:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265642.502434:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+19:24259:x1876180417621120:12345-0@lo:502:mount.lustre.0 Request processed in 116us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265642.502442:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789265642.503433:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417621120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265642.503495:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1789265642.503506:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1789265642.510969:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789265642.510979:0:24276:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789265642.510986:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265642.510988:0:24276:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789265642.510997:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789265642.511013:0:24276:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fccbd378000) 00000020:00000080:3.0:1789265642.511128:0:24276:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789265642.511135:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789265642.511225:0:24276:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fcb821f0000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789265642.511234:0:24276:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789265642.511240:0:24276:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9272d942b4a9820a 00010000:00010000:2.0:1789265642.519785:0:24276:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789265642.520212:0:24276:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1789265642.522256:0:24276:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1789265642.524267:0:24276:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789265642.524280:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265642.524287:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265642.524289:0:24276:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789265642.524292:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789265642.524295:0:24276:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1789265642.524296:0:24276:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789265642.524298:0:24276:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789265642.524314:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789265642.524318:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265642.524320:0:24276:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789265642.524323:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265642.524326:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265642.524327:0:24276:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789265642.524330:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789265642.524332:0:24276:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789265642.524341:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265642.524344:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265642.524345:0:24276:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789265642.524348:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265642.524351:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265642.524352:0:24276:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789265642.524355:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789265642.524382:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265642.524385:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265642.524386:0:24276:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789265642.524389:0:24276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1789265642.524571:0:24259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789265642.524602:0:24259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789265642.524632:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fee00/0x9272d942b4a981f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a981fc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265642.524644:0:24259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2fee00/0x9272d942b4a981f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a981fc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789265642.524652:0:24259:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fcb821f0000 from 1 10000000:01000000:1.0:1789265642.524655:0:24259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789265642.524702:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff400/0x9272d942b4a98211 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265642.524721:0:24259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff400/0x9272d942b4a98211 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265642.524732:0:24259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff400/0x9272d942b4a98211 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265642.524756:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417621248:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789265642.524820:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265642.525080:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83e9c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265642.526238:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417621248 00000100:00100000:0.0:1789265642.526248:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417621248 00000100:00100000:0.0:1789265642.526394:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789265642.526405:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+19:24259:x1876180417621248:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265642.526427:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265642.526441:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83da5000/0x9272d942b4a98218 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a98211 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265642.526464:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83da5000/0x9272d942b4a98218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a98211 expref: 20 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265642.526474:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83da5000/0x9272d942b4a98218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a98211 expref: 20 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265642.526484:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da5000, rc 0) 00000100:00100000:0.0:1789265642.526545:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+20:24259:x1876180417621248:12345-0@lo:101:mount.lustre.0 Request processed in 142us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265642.526552:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789265642.526817:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417621248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265642.526834:0:24259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff400/0x9272d942b4a98211 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98218 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.526844:0:24259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff400/0x9272d942b4a98211 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a98218 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265642.534570:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1789265642.535063:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265642.535250:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789265642.535272:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1789265642.535285:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1789265642.535298:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1789265642.535374:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1789265642.535390:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1789265642.535401:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1789265642.535526:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1789265642.535548:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1789265642.535675:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1789265642.535750:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1789265642.535775:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1789265642.535781:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1789265642.535858:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417621376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265642.535937:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265642.535976:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc8a6c0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265642.536085:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417621376 00000100:00100000:2.0:1789265642.536093:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417621376 00000100:00100000:2.0:1789265642.536131:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789265642.536140:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+20:24259:x1876180417621376:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265642.536242:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+20:24259:x1876180417621376:12345-0@lo:501:mount.lustre.0 Request processed in 103us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265642.536249:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789265642.536419:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417621376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265642.536515:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417621504:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265642.536673:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265642.536793:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc8a6c0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265642.539918:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417621504 00000100:00100000:1.0:1789265642.539929:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417621504 00000100:00100000:1.0:1789265642.539981:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789265642.539990:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+20:24259:x1876180417621504:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265642.540153:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+20:24259:x1876180417621504:12345-0@lo:503:mount.lustre.0 Request processed in 163us (3595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265642.540160:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789265642.540341:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417621504:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789265642.540990:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265642.541154:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417621632:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265642.541200:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265642.541282:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265642.548157:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417621632 00000100:00100000:1.0:1789265642.548172:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417621632 00000100:00100000:1.0:1789265642.548239:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789265642.548250:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+20:24259:x1876180417621632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265642.549112:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+20:24259:x1876180417621632:12345-0@lo:502:mount.lustre.0 Request processed in 861us (7909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265642.549122:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789265642.550278:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417621632:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265642.550694:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789265642.550726:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789265642.550741:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789265642.550766:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789265642.550782:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789265642.550795:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1789265642.550808:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1789265642.550837:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1789265642.550860:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1789265642.550892:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1789265642.550910:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1789265642.550947:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417621760:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265642.551083:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265642.551117:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0a7ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265642.551917:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417621760 00000100:00100000:0.0:1789265642.551926:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417621760 00000100:00100000:0.0:1789265642.552005:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789265642.552015:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+20:24259:x1876180417621760:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265642.552171:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+20:24259:x1876180417621760:12345-0@lo:502:mount.lustre.0 Request processed in 157us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265642.552179:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789265642.552460:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417621760:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265642.552521:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1789265642.552532:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789265642.553867:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265642.553887:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265642.553890:0:24280:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789265642.553896:0:24280:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fcb821f0000 00000020:00000080:2.0:1789265642.553900:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789265642.553909:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265642.553911:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265642.553913:0:24280:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789265642.553915:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265642.553918:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265642.553919:0:24280:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789265642.553922:0:24280:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fcb821f0000 00000020:00000080:2.0:1789265642.553924:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789265642.553986:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265642.553990:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265642.553992:0:24280:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789265642.553995:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265642.554008:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265642.554009:0:24280:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789265642.554013:0:24280:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fcb821f0000 00000020:00000080:2.0:1789265642.554015:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789265642.554920:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265642.554925:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265642.554927:0:24280:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789265642.554929:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789265642.554933:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265642.554934:0:24280:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789265642.554938:0:24280:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fcb821f0000 00000020:00000080:2.0:1789265642.554940:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789265642.554969:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789265642.554973:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789265642.554974:0:24280:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789265642.554978:0:24280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1789265642.555723:0:24259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789265642.555836:0:24259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265642.555866:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff400/0x9272d942b4a98211 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98218 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265642.555893:0:24259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff400/0x9272d942b4a98211 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98218 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265642.555955:0:24259:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789265642.555965:0:24259:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fcb821f0000 10000000:01000000:3.0:1789265642.555968:0:24259:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fcb821f0000 10000000:01000000:3.0:1789265642.555973:0:24259:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789265642.555979:0:24259:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fcb821f0000 from 1 10000000:01000000:3.0:1789265642.555981:0:24259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789265642.556016:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52600/0x9272d942b4a9821f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265642.556054:0:24259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52600/0x9272d942b4a9821f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265642.556067:0:24259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52600/0x9272d942b4a9821f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265642.556160:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417621888:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265642.556222:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265642.556302:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0a7ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265642.561647:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417621888 00000100:00100000:1.0:1789265642.561663:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417621888 00000100:00100000:1.0:1789265642.561843:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789265642.561862:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+20:24259:x1876180417621888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265642.561878:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265642.561908:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a98226 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9821f expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265642.561936:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a98226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9821f expref: 21 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265642.561948:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2ff600/0x9272d942b4a98226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9821f expref: 21 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265642.561957:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2ff600, rc 0) 00000100:00100000:1.0:1789265642.562056:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+21:24259:x1876180417621888:12345-0@lo:101:mount.lustre.0 Request processed in 198us (5833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265642.562063:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789265642.563864:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417621888:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265642.563902:0:24259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52600/0x9272d942b4a9821f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98226 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.563915:0:24259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52600/0x9272d942b4a9821f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a98226 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265642.571750:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1789265642.573981:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265642.574264:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1789265642.574296:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1789265642.574325:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1789265642.574343:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1789265642.574357:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1789265642.574368:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1789265642.574380:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1789265642.574393:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1789265642.574406:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1789265642.574432:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1789265642.574449:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1789265642.574466:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1789265642.574484:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1789265642.574514:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1789265642.574534:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1789265642.574550:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1789265642.574566:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1789265642.574595:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1789265642.574614:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1789265642.574629:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1789265642.574645:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1789265642.574659:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1789265642.574671:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1789265642.574685:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1789265642.574697:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1789265642.574709:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1789265642.574723:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1789265642.574738:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1789265642.574753:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1789265642.574772:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1789265642.574791:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1789265642.575208:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1789265642.575234:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1789265642.575267:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1789265642.575285:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1789265642.575301:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1789265642.575329:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1789265642.575347:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1789265642.575363:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1789265642.575375:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1789265642.575389:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1789265642.575404:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1789265642.575420:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1789265642.575432:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1789265642.575443:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1789265642.575454:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1789265642.575478:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1789265642.575493:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1789265642.575627:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1789265642.575645:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1789265642.575661:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1789265642.575666:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1789265642.575754:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417622016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265642.575996:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265642.576169:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265642.576198:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417622016 00000100:00100000:1.0:1789265642.576205:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417622016 00000100:00100000:1.0:1789265642.576250:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789265642.576259:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+21:24259:x1876180417622016:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265642.576386:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+21:24259:x1876180417622016:12345-0@lo:501:mount.lustre.0 Request processed in 128us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265642.576394:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789265642.576444:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417622016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789265642.576472:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417622144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265642.576512:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265642.576534:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265642.577076:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417622144 00000100:00100000:1.0:1789265642.577081:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417622144 00000100:00100000:1.0:1789265642.577117:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789265642.577125:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+21:24259:x1876180417622144:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789265642.577209:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+21:24259:x1876180417622144:12345-0@lo:503:mount.lustre.0 Request processed in 84us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265642.577216:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789265642.577267:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417622144:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789265642.577633:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789265642.577694:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417622272:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265642.577731:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265642.577812:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265642.577893:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417622272 00000100:00100000:3.0:1789265642.577898:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417622272 00000100:00100000:3.0:1789265642.577936:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789265642.577945:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b08b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+21:24259:x1876180417622272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265642.578055:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b08b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+21:24259:x1876180417622272:12345-0@lo:502:mount.lustre.0 Request processed in 112us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265642.578062:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789265642.578143:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417622272:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265642.578300:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789265642.578330:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1789265642.578346:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1789265642.578361:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1789265642.578378:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1789265642.578393:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1789265642.578410:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1789265642.578427:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1789265642.578440:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789265642.578451:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1789265642.578479:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1789265642.578499:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1789265642.578518:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1789265642.578539:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1789265642.578556:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1789265642.578571:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1789265642.578585:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1789265642.578601:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1789265642.578615:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1789265642.578629:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1789265642.578643:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1789265642.578657:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1789265642.578670:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1789265642.578684:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1789265642.578707:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1789265642.578719:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1789265642.578743:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1789265642.578758:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1789265642.578772:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1789265642.578786:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1789265642.578800:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1789265642.578815:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1789265642.578835:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1789265642.578852:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1789265642.578869:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1789265642.578951:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1789265642.578970:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1789265642.578983:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1789265642.578994:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1789265642.579006:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1789265642.579019:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1789265642.579101:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1789265642.579132:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1789265642.579150:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1789265642.579164:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1789265642.579177:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1789265642.579192:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1789265642.579207:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1789265642.579244:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417622400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265642.579291:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265642.579320:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265642.579767:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417622400 00000100:00100000:2.0:1789265642.579774:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417622400 00000100:00100000:2.0:1789265642.579857:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789265642.579867:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+21:24259:x1876180417622400:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265642.579999:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+21:24259:x1876180417622400:12345-0@lo:502:mount.lustre.0 Request processed in 134us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265642.580007:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789265642.580110:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417622400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265642.580257:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1789265642.580278:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1789265642.580300:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417622528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789265642.580337:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265642.582286:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb838d8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265642.583237:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417622528 00000100:00100000:3.0:1789265642.583247:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417622528 00000100:00100000:3.0:1789265642.583293:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789265642.583304:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+21:24259:x1876180417622528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265642.583523:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+21:24259:x1876180417622528:12345-0@lo:502:mount.lustre.0 Request processed in 220us (3183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265642.583531:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789265642.583665:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417622528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789265642.583751:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1789265642.583764:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789265642.590661:0:24285:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789265642.590678:0:24285:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fcb829fcd28) 00000020:00000080:2.0:1789265642.590854:0:24285:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1789265642.590943:0:24285:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fcb821f0000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789265642.590948:0:24285:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fcb821f0000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789265642.590950:0:24285:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fcb821f0000 3 00010000:00080000:2.0:1789265642.590977:0:24285:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcb82c51000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.149@tcp at head 00010000:00010000:2.0:1789265642.594267:0:24285:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1789265642.596903:0:24285:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789265642.596968:0:24285:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789265642.596982:0:24285:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9272d942b4a98234 00000100:00080000:2.0:1789265642.596995:0:24285:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789265642.597001:0:24285:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fcb82c51000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:2.0:1789265642.597059:0:24285:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83c9b100 x1876180417622656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789265642.597081:0:24285:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789265642.597122:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265642.597125:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265642.597128:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265642.597130:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265642.597154:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265642.597158:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265642.597167:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265642.597170:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789265642.597203:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417622784:0@lo:400:kworker.0 00000100:00100000:2.0:1789265642.597269:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265642.597303:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265642.597309:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417622912:0@lo:400:kworker.0 00000100:00100000:2.0:1789265642.597332:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265642.597366:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417623168:0@lo:400:kworker.0 00000100:00100000:2.0:1789265642.597389:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265642.597404:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789265642.597410:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417623040:0@lo:400:kworker.0 00000100:00100000:3.0:1789265642.599549:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876180417622656:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789265642.599630:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265642.599862:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417622784 00000100:00100000:3.0:1789265642.599870:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417622784 00000100:00100000:3.0:1789265642.599925:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789265642.599934:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417622784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265642.599992:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417622784:12345-0@lo:400:kworker.0 Request processed in 59us (2723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265642.599999:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789265642.600045:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417622912 00000100:00100000:3.0:1789265642.600049:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417622912 00000100:00100000:3.0:1789265642.600065:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417623168 00000100:00100000:3.0:1789265642.600067:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417623168 00000100:00100000:3.0:1789265642.600076:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417622656 00000100:00100000:3.0:1789265642.600078:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417622656 00000100:00100000:3.0:1789265642.600089:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265642.600094:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417622912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265642.600123:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417622912:12345-0@lo:400:kworker.0 Request processed in 29us (2790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265642.600129:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265642.600141:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265642.600146:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417623168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265642.600171:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417623168:12345-0@lo:400:kworker.0 Request processed in 24us (2781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265642.600177:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265642.600186:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265642.600190:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876180417622656:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789265642.600210:0:22759:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:3.0:1789265642.600253:0:22759:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9272d942b4a9823b 00000004:00100000:3.0:1789265642.600268:0:22759:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789265642.600295:0:22759:0:(import.c:65:import_set_state_nolock()) ffff9fcca789a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265642.600332:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876180417622656:12345-0@lo:38:llog_process_th.0 Request processed in 140us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265642.600339:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789265642.600383:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb83c98000 x1876180417622912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265642.600397:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417622912:0@lo:400:kworker.0 00000100:00100000:3.0:1789265642.600409:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417622784:0@lo:400:kworker.0 00010000:00080000:3.0:1789265642.600684:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb83c9b100 x1876180417622656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265642.600757:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265642.600765:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1789265642.600772:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789265642.600776:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789265642.600779:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb82c51000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789265642.600784:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876180417622656:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789265642.600919:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789265642.600957:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fcb83c99180 x1876180417623168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265642.600966:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417623168:0@lo:400:kworker.0 00000100:00100000:0.0:1789265642.601108:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417623040 00000100:00100000:0.0:1789265642.601113:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417623040 00000100:00100000:0.0:1789265642.601137:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789265642.601144:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417623040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265642.601184:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417623040:12345-0@lo:400:kworker.0 Request processed in 40us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265642.601190:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789265642.601411:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417623040:0@lo:400:kworker.0 00000020:01000004:0.0:1789265642.601856:0:24285:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789265642.601870:0:24285:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9fccbf45b370) 00000020:00000080:0.0:1789265642.601898:0:24285:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1789265642.601995:0:24285:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fcb821f0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789265642.602000:0:24285:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fcb821f0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789265642.602003:0:24285:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fcb821f0000 3 00010000:00080000:0.0:1789265642.602060:0:24285:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcc875d2000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.149@tcp at head 00010000:00010000:0.0:1789265642.605910:0:24285:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1789265642.606172:0:24285:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789265642.606215:0:24285:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789265642.606226:0:24285:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x9272d942b4a98249 00000100:00080000:0.0:1789265642.606235:0:24285:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265642.606241:0:24285:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9fcc875d2000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265642.606274:0:24285:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fccbf40c000 x1876180417623296/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265642.606303:0:24285:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789265642.606329:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265642.606338:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265642.606341:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265642.606343:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265642.606346:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265642.606349:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265642.606351:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265642.606354:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789265642.606994:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1876180417623296:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789265642.607076:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265642.607133:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417623296 00000100:00100000:3.0:1789265642.607139:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417623296 00000100:00100000:3.0:1789265642.607169:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265642.607176:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876180417623296:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789265642.607209:0:22759:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:3.0:1789265642.607243:0:22759:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x9272d942b4a98250 00000004:00100000:3.0:1789265642.607256:0:22759:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789265642.607282:0:22759:0:(import.c:65:import_set_state_nolock()) ffff9fcca789e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265642.607326:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876180417623296:12345-0@lo:38:llog_process_th.0 Request processed in 149us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265642.607333:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789265642.607746:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fccbf40c000 x1876180417623296/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265642.607756:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265642.607764:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1789265642.607770:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789265642.607775:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789265642.607777:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcc875d2000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789265642.607783:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1876180417623296:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789265642.608157:0:24285:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1789265642.608657:0:24259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789265642.608685:0:24259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789265642.608895:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52600/0x9272d942b4a9821f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98226 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265642.608907:0:24259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83f52600/0x9272d942b4a9821f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98226 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789265642.609004:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789265642.609007:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789265642.609008:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265642.609009:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265642.609010:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265642.609012:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265642.609013:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265642.609014:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265642.609016:0:24259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265642.609019:0:24259:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789265642.609406:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789265642.609408:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789265642.609409:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789265642.609410:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789265642.609411:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789265642.609412:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789265642.609413:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789265642.609415:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789265642.609416:0:24259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789265642.609486:0:24259:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789265642.609503:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417623424:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789265642.609671:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265642.609706:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc8a6c0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789265642.609753:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417623424 00000100:00100000:3.0:1789265642.609760:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417623424 00000100:00100000:3.0:1789265642.609836:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789265642.609845:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+21:24259:x1876180417623424:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789265642.609866:0:22754:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789265642.609877:0:22754:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789265642.612542:0:22754:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789265642.612585:0:22754:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789265642.612914:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+21:24259:x1876180417623424:12345-0@lo:253:mount.lustre.0 Request processed in 3066us (3295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265642.612927:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789265642.613063:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:24259:1876180417623424:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789265642.613077:0:24259:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789265642.613081:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789265642.613083:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789265642.613084:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265642.613085:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265642.613087:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265642.613088:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265642.613090:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265642.613092:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265642.613093:0:24259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789265642.613106:0:24259:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1789265642.614197:0:22775:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789265642.614203:0:22775:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789265642.614220:0:22775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98257 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265642.614236:0:22775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a981a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9819a expref: 20 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265642.614244:0:22775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb83f53a00/0x9272d942b4a981af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a981a8 expref: 20 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265642.614251:0:22775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98257 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265642.614282:0:22775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb83f53a00/0x9272d942b4a981af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a981a8 expref: 20 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265642.614294:0:22775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb83f53a00/0x9272d942b4a981af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a981a8 expref: 20 pid: 22752 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265642.614307:0:22775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22775:1876180417623552:0@lo:104: 00000100:00100000:1.0:1789265642.614349:0:22775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265642.614437:0:22775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a981a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a9819a expref: 20 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265642.614447:0:22775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a981a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a9819a expref: 20 pid: 22752 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265642.614454:0:22775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22775:1876180417623680:0@lo:104: 00000100:00100000:1.0:1789265642.614487:0:22775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:0.0:1789265642.615715:0:24259:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1789265642.618085:0:24259:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789265642.618095:0:24259:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789265642.618128:0:24259:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789265642.618171:0:24259:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.149@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789265642.618197:0:24259:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789265642.618214:0:24259:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789265642.619939:0:24259:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:1.0:1789265642.619947:0:22775:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789265642.620521:0:22742:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789265642.620546:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417623552 00000100:00100000:2.0:1789265642.620555:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417623552 00000100:00100000:2.0:1789265642.620593:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417623680 00000100:00100000:2.0:1789265642.620597:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417623680 00000100:00100000:2.0:1789265642.620615:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265642.620624:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82fe313a-a4f8-4781-be1f-82c20160e337+4:22775:x1876180417623552:12345-0@lo:104: 00010000:00010000:2.0:1789265642.620640:0:22742:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4600/0x9272d942b4a981a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a981af expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:0.0:1789265642.620982:0:24259:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789265642.621439:0:22743:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:1.0:1789265642.621446:0:22743:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789265642.621452:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1789265642.622797:0:22742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265642.622808:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82fe313a-a4f8-4781-be1f-82c20160e337+4:22775:x1876180417623552:12345-0@lo:104: Request processed in 2183us (8456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265642.622818:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265642.622848:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265642.622857:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb73cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82fe313a-a4f8-4781-be1f-82c20160e337+3:22775:x1876180417623680:12345-0@lo:104: 00010000:00010000:2.0:1789265642.622871:0:22742:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a9819a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a981a1 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.622932:0:22742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265642.622938:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb73cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82fe313a-a4f8-4781-be1f-82c20160e337+3:22775:x1876180417623680:12345-0@lo:104: Request processed in 83us (8450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265642.622944:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789265642.622984:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265642.622990:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4600/0x9272d942b4a981a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a981af expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.622999:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4600 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265642.623003:0:22748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4600/0x9272d942b4a981a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a981af expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.623013:0:22748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4600/0x9272d942b4a981a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a981af expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265642.623038:0:22748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4600/0x9272d942b4a981a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a981af expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265642.623046:0:22748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265642.623090:0:22748:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4600/0x9272d942b4a981a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a981af expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.623097:0:22748:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265642.623116:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4600/0x9272d942b4a981a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a981af expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.623124:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4600/0x9272d942b4a981a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a981af expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.623135:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265642.623139:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a9819a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a981a1 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.623145:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e000 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265642.623149:0:22748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a9819a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a981a1 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.623156:0:22748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a9819a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a981a1 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265642.623162:0:22748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a9819a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a981a1 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265642.623168:0:22748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265642.623181:0:22748:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a9819a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a981a1 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.623187:0:22748:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265642.623192:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a9819a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a981a1 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.623208:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a9819a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a981a1 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.623222:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265642.623224:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265642.623226:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265642.623241:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82fe313a-a4f8-4781-be1f-82c20160e337:3642:1876180417623936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265642.623278:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265642.623312:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265642.623318:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82fe313a-a4f8-4781-be1f-82c20160e337:3642:1876180417623808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265642.623338:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265642.623624:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265642.623640:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417623936 00000100:00100000:0.0:1789265642.623647:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417623936 00010000:00010000:0.0:1789265642.623671:0:22746:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a981a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9819a expref: 21 pid: 22752 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265642.623760:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417623808 00000100:00100000:0.0:1789265642.623764:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417623808 00010000:00010000:0.0:1789265642.623777:0:22746:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb83f53a00/0x9272d942b4a981af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a981a8 expref: 22 pid: 22752 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265642.623790:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265642.623796:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82fe313a-a4f8-4781-be1f-82c20160e337+22:3642:x1876180417623936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265642.623806:0:22746:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265642.623812:0:22746:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a981a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9819a expref: 22 pid: 22752 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265642.623821:0:22746:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a981a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a9819a expref: 22 pid: 22752 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265642.623837:0:22746:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265642.623868:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82fe313a-a4f8-4781-be1f-82c20160e337+22:3642:x1876180417623936:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265642.623874:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789265642.623899:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265642.623904:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaea74050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82fe313a-a4f8-4781-be1f-82c20160e337+21:3642:x1876180417623808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265642.623911:0:22746:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265642.623915:0:22746:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb83f53a00/0x9272d942b4a981af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a981a8 expref: 21 pid: 22752 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265642.623934:0:22746:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb83f53a00/0x9272d942b4a981af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a981a8 expref: 21 pid: 22752 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265642.623947:0:22746:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98257 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265642.623955:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98257 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789265642.623969:0:22746:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009766829s 00010000:00010000:0.0:1789265642.623974:0:22746:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98257 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265642.623980:0:22746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98257 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265642.623986:0:22746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98257 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265642.623991:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98257 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265642.623997:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265642.624000:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98257 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265642.624007:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98257 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265642.624016:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98257 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265642.624048:0:22746:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265642.624072:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaea74050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82fe313a-a4f8-4781-be1f-82c20160e337+21:3642:x1876180417623808:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265642.624078:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789265642.624129:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82fe313a-a4f8-4781-be1f-82c20160e337:3642:1876180417623808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265642.624138:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82fe313a-a4f8-4781-be1f-82c20160e337:3642:1876180417623936:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265642.633572:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83f53a00/0x9272d942b4a981af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a981a8 expref: 20 pid: 22752 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265642.633593:0:22775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22775:1876180417623552:0@lo:104: 00010000:00010000:2.0:1789265642.633607:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a981a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a9819a expref: 19 pid: 22752 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265642.633617:0:22775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22775:1876180417623680:0@lo:104: 00010000:00010000:2.0:1789265642.633642:0:22775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98257 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.633651:0:22775:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98257 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.633657:0:22775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98257 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265642.633679:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2fe800/0x9272d942b4a98257 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265643.012169:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417624064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265643.012253:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265643.012322:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417624064 00000100:00100000:3.0:1789265643.012328:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417624064 00000100:00100000:3.0:1789265643.012368:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265643.012376:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417624064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265643.012407:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789265643.012475:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417624064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265643.012482:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265643.012534:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417624064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265643.013363:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417624192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265643.013399:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265643.013618:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417624192 00000100:00100000:2.0:1789265643.013624:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417624192 00000100:00100000:2.0:1789265643.013663:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265643.013671:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417624192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265643.013694:0:22765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789265643.013749:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417624192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265643.013756:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789265643.014180:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417624192:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789265643.396530:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789265643.566756:0:24339:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265643.566995:0:24339:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1789265644.375952:0:22757:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789265644.375960:0:22757:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fccb092a000 from 13 10000000:01000000:2.0:1789265644.375966:0:22757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789265644.376006:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a9825e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265644.376018:0:22757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a9825e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265644.376045:0:22757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a9825e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265644.376071:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417624320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265644.376135:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265644.376189:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccadbf0780 going to sleep for 11 seconds 00000100:00100000:0.0:1789265644.376264:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417624320 00000100:00100000:0.0:1789265644.376271:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417624320 00000100:00100000:0.0:1789265644.376326:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789265644.376336:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+19:22757:x1876180417624320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265644.376348:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265644.376362:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a98265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9825e expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265644.376385:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a98265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9825e expref: 20 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265644.376396:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a98265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9825e expref: 20 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265644.376406:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83da4000, rc 0) 00000100:00100000:0.0:1789265644.376447:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+20:22757:x1876180417624320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265644.376453:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789265644.376499:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417624320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265644.376526:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a9825e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98265 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265644.376535:0:22757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a9825e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a98265 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265644.376581:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417624448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789265644.376614:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265644.376641:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada67a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265644.376708:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417624448 00000100:00100000:2.0:1789265644.376719:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417624448 00000100:00100000:2.0:1789265644.376755:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789265644.376762:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+20:22757:x1876180417624448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789265644.376775:0:22752:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789265644.376789:0:22752:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789265644.376792:0:22752:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1789265644.376880:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+20:22757:x1876180417624448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265644.376887:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789265644.376957:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417624448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789265644.377011:0:22757:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265644.377017:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a9825e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98265 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265644.377053:0:22757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a9825e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98265 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265644.377062:0:22757:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265644.377063:0:22757:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fccbc1ce800 from 13 10000000:01000000:0.0:1789265644.377066:0:22757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265644.377083:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4e00/0x9272d942b4a9826c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265644.377089:0:22757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4e00/0x9272d942b4a9826c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265644.377096:0:22757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4e00/0x9272d942b4a9826c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265644.377117:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417624576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265644.377141:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265644.377155:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada67a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265644.377474:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417624576 00000100:00100000:2.0:1789265644.377479:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417624576 00000100:00100000:2.0:1789265644.377500:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789265644.377507:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+20:22757:x1876180417624576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265644.377514:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265644.377523:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2f000/0x9272d942b4a98273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9826c expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265644.377537:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2f000/0x9272d942b4a98273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9826c expref: 21 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265644.377544:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb84a2f000/0x9272d942b4a98273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9826c expref: 21 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265644.377551:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2f000, rc 0) 00000100:00100000:2.0:1789265644.377579:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+21:22757:x1876180417624576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265644.377584:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789265644.377664:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417624576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789265644.377675:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4e00/0x9272d942b4a9826c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98273 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265644.377683:0:22757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4e00/0x9272d942b4a9826c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a98273 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265644.377719:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417624704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789265644.377747:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265644.377773:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada67a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265644.377817:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417624704 00000100:00100000:2.0:1789265644.377821:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417624704 00000100:00100000:2.0:1789265644.377856:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789265644.377862:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+21:22757:x1876180417624704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789265644.377882:0:22752:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789265644.377894:0:22752:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789265644.377897:0:22752:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1789265644.377952:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+21:22757:x1876180417624704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 90us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265644.377959:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789265644.378046:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417624704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789265644.378085:0:22757:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265644.378090:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4e00/0x9272d942b4a9826c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98273 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265644.378097:0:22757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4e00/0x9272d942b4a9826c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98273 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265644.427631:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265645.442139:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265646.467545:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265646.792145:0:22793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789265647.493988:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789265647.618180:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265647.618185:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265647.618188:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265647.618190:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265647.618216:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265647.618219:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265647.618221:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265647.618223:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789265647.618260:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417625088:0@lo:400:kworker.0 00000100:00100000:2.0:1789265647.618325:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265647.618355:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417625600:0@lo:400:kworker.0 00000100:00100000:2.0:1789265647.618391:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265647.618417:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265647.618422:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417625216:0@lo:400:kworker.0 00000100:00100000:2.0:1789265647.618454:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265647.618788:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417624960:0@lo:400:kworker.0 00000100:00100000:1.0:1789265647.618821:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265647.618889:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417624832:0@lo:400:kworker.0 00000100:00100000:0.0:1789265647.618931:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265647.622752:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417625472:0@lo:400:kworker.0 00000100:00100000:1.0:1789265647.622817:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265647.622881:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417625088 00000100:00100000:1.0:1789265647.622889:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417625088 00000100:00100000:1.0:1789265647.622923:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417625600 00000100:00100000:1.0:1789265647.622926:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417625600 00000100:00100000:1.0:1789265647.622949:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417625472 00000100:00100000:1.0:1789265647.622953:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417625472 00000100:00100000:1.0:1789265647.622967:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265647.622975:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417625088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265647.623046:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417625088:12345-0@lo:400:kworker.0 Request processed in 71us (4721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265647.623054:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265647.623070:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265647.623077:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417625600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265647.623106:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417625600:12345-0@lo:400:kworker.0 Request processed in 31us (4715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265647.623112:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265647.623123:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265647.623129:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417625472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265647.623169:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417625472:12345-0@lo:400:kworker.0 Request processed in 40us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265647.623175:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789265647.623204:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265647.623208:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789265647.623250:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83c9a680 x1876180417625088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265647.623263:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417625088:0@lo:400:kworker.0 00010000:00080000:1.0:1789265647.623279:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83d46300 x1876180417625600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265647.623287:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417625600:0@lo:400:kworker.0 00010000:00080000:1.0:1789265647.623325:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83c98000 x1876180417625472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265647.623334:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417625472:0@lo:400:kworker.0 00000100:00100000:2.0:1789265647.623787:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417625216 00000100:00100000:2.0:1789265647.623792:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417625216 00000100:00100000:2.0:1789265647.623822:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417624960 00000100:00100000:2.0:1789265647.623825:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417624960 00000100:00100000:2.0:1789265647.623838:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265647.623844:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417625216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265647.623895:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417625216:12345-0@lo:400:kworker.0 Request processed in 51us (5439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265647.623900:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265647.623912:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265647.623917:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417624960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265647.623944:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417624960:12345-0@lo:400:kworker.0 Request processed in 27us (5124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265647.623949:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789265647.624298:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417624960:0@lo:400:kworker.0 00000100:00100000:1.0:1789265647.624328:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417625216:0@lo:400:kworker.0 00000100:00100000:1.0:1789265647.624764:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417625344:0@lo:400:kworker.0 00000100:00100000:1.0:1789265647.624800:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265647.625131:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417624832 00000100:00100000:0.0:1789265647.625138:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417624832 00000100:00100000:0.0:1789265647.625188:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789265647.625196:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+21:3641:x1876180417624832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265647.625241:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+21:3641:x1876180417624832:12345-0@lo:400:kworker.0 Request processed in 47us (6309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265647.625247:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789265647.625729:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417625344 00000100:00100000:3.0:1789265647.625734:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417625344 00000100:00100000:3.0:1789265647.625803:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789265647.625811:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417625344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265647.625861:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417625344:12345-0@lo:400:kworker.0 Request processed in 51us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265647.625867:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265647.626092:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417624832:0@lo:400:kworker.0 00010000:00080000:1.0:1789265647.626107:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83c99880 x1876180417625344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265647.626117:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417625344:0@lo:400:kworker.0 00000100:00100000:1.0:1789265648.129724:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417625728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265648.129794:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265648.129875:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265648.129884:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417625856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265648.129909:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265648.132525:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417625728 00000100:00100000:2.0:1789265648.132539:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417625728 00000100:00100000:2.0:1789265648.132602:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417625856 00000100:00100000:2.0:1789265648.132606:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417625856 00000100:00100000:2.0:1789265648.132626:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265648.132636:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417625728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265648.132671:0:23784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789265648.132746:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417625728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (2951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265648.132754:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265648.132770:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789265648.132777:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417625856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265648.132818:0:23784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789265648.132864:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417625856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (2954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265648.132870:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789265648.134999:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417625856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265648.135067:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417625728:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789265648.515056:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789265649.455604:0:24630:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789265649.539138:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265649.921796:0:23512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789265650.565406:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789265650.585079:0:24682:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789265650.585349:0:24682:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789265651.587729:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789265651.764265:0:24733:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265651.765950:0:24733:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789265652.614148:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265652.738349:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82fe313a-a4f8-4781-be1f-82c20160e337:3642:1876180417625984:0@lo:400:kworker.0 00000100:00100000:1.0:1789265652.738430:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265652.738518:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417625984 00000100:00100000:3.0:1789265652.738526:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417625984 00000100:00100000:3.0:1789265652.738574:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789265652.738583:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+21:3642:x1876180417625984:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789265652.738719:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265652.738723:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265652.738726:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265652.738729:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789265652.743001:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+21:3642:x1876180417625984:12345-0@lo:400:kworker.0 Request processed in 4408us (4558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265652.743016:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1789265652.744728:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265652.744736:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789265652.744739:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789265652.744742:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789265652.744808:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417626368:0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.744880:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265652.744915:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789265652.744921:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417626496:0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.744940:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265652.744972:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417626112:0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.744994:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265652.745012:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417626624:0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.745054:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265652.745069:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789265652.745075:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417626240:0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.745092:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265652.745104:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417626752:0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.745122:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265652.745149:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417626368 00000100:00100000:0.0:1789265652.745155:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417626368 00000100:00100000:0.0:1789265652.745188:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417626112 00000100:00100000:0.0:1789265652.745191:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417626112 00000100:00100000:0.0:1789265652.745203:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265652.745211:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417626368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.745257:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417626368:12345-0@lo:400:kworker.0 Request processed in 46us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265652.745264:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789265652.745277:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265652.745283:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417626112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.745308:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417626112:12345-0@lo:400:kworker.0 Request processed in 26us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265652.745326:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789265652.745341:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417626496 00000100:00100000:0.0:1789265652.745344:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417626496 00000100:00100000:0.0:1789265652.745475:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417626624 00000100:00100000:0.0:1789265652.745478:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417626624 00000100:00100000:0.0:1789265652.745508:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417626240 00000100:00100000:0.0:1789265652.745511:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417626240 00000100:00100000:0.0:1789265652.745519:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417626752 00000100:00100000:0.0:1789265652.745521:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417626752 00000100:00100000:0.0:1789265652.745534:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265652.745540:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417626496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.745568:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417626496:12345-0@lo:400:kworker.0 Request processed in 29us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265652.745575:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789265652.745585:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265652.745590:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417626624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.745610:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417626624:12345-0@lo:400:kworker.0 Request processed in 21us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265652.745616:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789265652.745625:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265652.745630:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417626240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.745924:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417626240:12345-0@lo:400:kworker.0 Request processed in 21us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265652.745933:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265652.745945:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265652.745951:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417626752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.745979:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417626752:12345-0@lo:400:kworker.0 Request processed in 29us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265652.745985:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789265652.746013:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265652.746017:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789265652.746062:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbf40d500 x1876180417626496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265652.746082:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417626496:0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.746093:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417626368:0@lo:400:kworker.0 00010000:00080000:0.0:1789265652.746122:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbf40ce00 x1876180417626240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265652.746131:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417626240:0@lo:400:kworker.0 00010000:00080000:0.0:1789265652.746139:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbf40c380 x1876180417626752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265652.746146:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417626752:0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.746154:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417626112:0@lo:400:kworker.0 00010000:00080000:0.0:1789265652.746162:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbf40f100 x1876180417626624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265652.746169:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417626624:0@lo:400:kworker.0 00000100:00100000:1.0:1789265652.746288:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82fe313a-a4f8-4781-be1f-82c20160e337:3642:1876180417625984:0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.865149:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265637/real 1789265637] req@ffff9fcb83d44a80 x1876180417619072/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265652 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265652.865179:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83d44a80 x1876180417619072/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265652 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265652.865190:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265637/real 1789265637] req@ffff9fcb83d47800 x1876180417619200/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265652 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265652.865201:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83d47800 x1876180417619200/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265652 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789265652.865232:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcc83e0d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265652.865253:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789265652.865264:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417619072:0@lo:8:kworker.0 00000100:00080000:0.0:1789265652.865269:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcca789a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265652.865274:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789265652.865277:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417619200:0@lo:8:kworker.0 00000100:00080000:1.0:1789265652.865874:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265652.865879:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265652.865935:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265652.865939:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789265652.865960:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265652.865963:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789265652.865965:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcc83e0d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265652.865971:0:17249:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 689 00000100:00080000:1.0:1789265652.865976:0:17249:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789265652.865982:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fcc83e0d800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265652.866002:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb84845500 x1876180417627392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789265652.866040:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789265652.866044:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789265652.866046:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcca789a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789265652.866049:0:17249:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 689 00000100:00080000:1.0:1789265652.866052:0:17249:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789265652.866056:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fcca789a800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:1.0:1789265652.866068:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb84847800 x1876180417627520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265652.866152:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417626880:0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.866215:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265652.866294:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417627008:0@lo:400:kworker.0 00000100:00100000:2.0:1789265652.866323:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265652.866349:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417627776:0@lo:400:kworker.0 00000100:00100000:2.0:1789265652.866372:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265652.867075:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417627648:0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.867103:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265652.867135:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417627136:0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.867155:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265652.867169:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417627904:0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.867185:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265652.867194:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265652.867199:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417627264:0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.867215:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265652.867242:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417627008 00000100:00100000:0.0:1789265652.867248:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417627008 00000100:00100000:0.0:1789265652.867291:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417627264 00000100:00100000:0.0:1789265652.867294:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417627264 00000100:00100000:0.0:1789265652.867308:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265652.867316:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417627008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.867365:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417627008:12345-0@lo:400:kworker.0 Request processed in 50us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265652.867378:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789265652.867393:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265652.867399:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417627264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.867427:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417627264:12345-0@lo:400:kworker.0 Request processed in 29us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265652.867433:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789265652.867448:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417627776 00000100:00100000:0.0:1789265652.867450:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417627776 00000100:00100000:0.0:1789265652.867465:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417627648 00000100:00100000:0.0:1789265652.867467:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417627648 00000100:00100000:0.0:1789265652.867475:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417627136 00000100:00100000:0.0:1789265652.867477:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417627136 00000100:00100000:0.0:1789265652.867485:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417627904 00000100:00100000:0.0:1789265652.867487:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417627904 00000100:00100000:0.0:1789265652.867498:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265652.867503:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417627776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.867527:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417627776:12345-0@lo:400:kworker.0 Request processed in 23us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265652.867532:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265652.867542:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265652.867547:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417627648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.867571:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417627648:12345-0@lo:400:kworker.0 Request processed in 24us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265652.867577:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789265652.867586:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265652.867592:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417627136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.867622:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417627136:12345-0@lo:400:kworker.0 Request processed in 30us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265652.867628:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265652.867637:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789265652.867642:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417627904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.867662:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417627904:12345-0@lo:400:kworker.0 Request processed in 20us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265652.867668:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789265652.867704:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417627264:0@lo:400:kworker.0 00010000:00080000:0.0:1789265652.867715:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb84844380 x1876180417627136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265652.867724:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417627136:0@lo:400:kworker.0 00010000:00080000:0.0:1789265652.867732:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb84845880 x1876180417627904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265652.867740:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417627904:0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.867765:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417627008:0@lo:400:kworker.0 00010000:00080000:0.0:1789265652.867773:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb84846a00 x1876180417627776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265652.867781:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417627776:0@lo:400:kworker.0 00000100:00100000:0.0:1789265652.867797:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417627392:0@lo:8:kworker.0 00000100:00100000:0.0:1789265652.867838:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265652.867854:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417627520:0@lo:8:kworker.0 00000100:00100000:0.0:1789265652.867882:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265652.867914:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417627392 00000100:00100000:0.0:1789265652.867918:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417627392 00000100:00100000:0.0:1789265652.867932:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417627520 00000100:00100000:0.0:1789265652.867934:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417627520 00000100:00100000:0.0:1789265652.867942:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265652.867947:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1876180417627392:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789265652.867969:0:24264:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 704 last 0 00000020:00000080:0.0:1789265652.867994:0:24264:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a9827a 00002000:00100000:0.0:1789265652.868007:0:24264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9fcb82f3c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1789265652.868012:0:24264:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1789265652.868014:0:24264:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789265652.868200:0:24264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1789265652.868222:0:24264:0:(import.c:65:import_set_state_nolock()) ffff9fcb82f3d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265652.868256:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1876180417627392:12345-0@lo:8:kworker.0 Request processed in 307us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265652.868262:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789265652.868275:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265652.868279:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1876180417627520:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789265652.868289:0:24264:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789265652.873776:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417626880 00000100:00100000:1.0:1789265652.873789:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417626880 00000100:00100000:1.0:1789265652.873862:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789265652.873873:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+21:3641:x1876180417626880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265652.873960:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+21:3641:x1876180417626880:12345-0@lo:400:kworker.0 Request processed in 90us (7744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265652.873968:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789265652.874166:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417626880:0@lo:400:kworker.0 00010000:00080000:1.0:1789265652.874185:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb84845f80 x1876180417627648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265652.874197:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417627648:0@lo:400:kworker.0 00010000:00080000:3.0:1789265652.875519:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb84845500 x1876180417627392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265652.875531:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789265652.875541:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789265652.875550:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789265652.875555:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789265652.875559:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcc83e0d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789265652.875586:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789265652.875592:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417627392:0@lo:8:kworker.0 00000100:00100000:3.0:1789265652.875789:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417628032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265652.875854:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789265652.875906:0:23501:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789265652.875929:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23501:1876180417628160:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1789265652.875960:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265652.875977:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc98f17300 going to sleep for 11 seconds 00000100:00100000:1.0:1789265652.876010:0:24266:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789265652.876017:0:24266:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789265652.884098:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417628032 00000100:00100000:2.0:1789265652.884111:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417628032 00000100:00100000:2.0:1789265652.884174:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789265652.884184:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1876180417628032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265652.884214:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789265652.891955:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1876180417628032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7763us (16091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265652.891972:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789265652.893187:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb84845f80 x1876180417628032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265652.893213:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417628032:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1789265652.898397:0:23500:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789265652.898486:0:23500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 704128463216ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789265652.898493:0:23500:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789265652.900373:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417628160 00000100:00100000:2.0:1789265652.900384:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417628160 00000100:00100000:3.0:1789265652.900546:0:24771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265652.900556:0:24771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23501:x1876180417628160:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789265652.904451:0:23492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00080000:0.0:1789265652.905853:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265652.905936:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1876180417627520:12345-0@lo:8:kworker.0 Request processed in 37651us (38048us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789265652.905948:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789265652.905995:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcca789a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789265652.906001:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789265652.906012:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417627520:0@lo:8:kworker.0 00002000:00080000:1.0:1789265652.908779:0:24771:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789265652.908787:0:24771:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789265652.908892:0:24771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23501:x1876180417628160:12345-0@lo:7:osp-pre-0-1.0 Request processed in 8335us (32927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265652.908902:0:24771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789265652.909412:0:23501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb84846d80 x1876180417628160/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265668 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265652.909428:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23501:1876180417628160:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789265652.909442:0:23501:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1789265652.909480:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23501:1876180417628288:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789265652.909518:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265652.909545:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99137e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265652.909655:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417628288 00000100:00100000:1.0:1789265652.909672:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417628288 00000100:00100000:1.0:1789265652.914183:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789265652.914204:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23501:x1876180417628288:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789265652.914237:0:24266:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1789265652.914863:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23501:x1876180417628288:12345-0@lo:5:osp-pre-0-1.0 Request processed in 666us (5343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265652.914873:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789265652.918107:0:23501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbf40f800 x1876180417628288/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265668 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265652.918125:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23501:1876180417628288:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789265652.918138:0:23501:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1789265652.918181:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23501:1876180417628416:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789265652.918231:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265652.918722:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99137e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789265652.918741:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417628416 00000100:00100000:0.0:1789265652.918748:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417628416 00000100:00100000:0.0:1789265652.918843:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789265652.918852:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23501:x1876180417628416:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789265652.918885:0:24264:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:2.0:1789265652.949054:0:24260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1789265652.949068:0:24260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789265652.949478:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23501:x1876180417628416:12345-0@lo:5:osp-pre-0-1.0 Request processed in 30622us (31241us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789265652.949490:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789265652.949567:0:23501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fccbf40f800 x1876180417628416/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265668 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265652.949579:0:23501:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1789265652.949585:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23501:1876180417628416:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789265652.949600:0:23501:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1789265652.949642:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23501:1876180417628544:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789265652.949674:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265652.949700:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3e29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265652.949752:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417628544 00000100:00100000:0.0:1789265652.949764:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417628544 00000100:00100000:0.0:1789265652.949804:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789265652.949821:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23501:x1876180417628544:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789265652.949869:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23501:x1876180417628544:12345-0@lo:900:osp-pre-0-1.0 Request processed in 58us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265652.949876:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789265652.949968:0:23501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb84846a00 x1876180417628544/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789265668 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265652.949990:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23501:1876180417628544:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789265653.249761:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789265653.249785:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417628672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265653.249865:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265653.250144:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417628672 00000100:00100000:3.0:1789265653.250151:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417628672 00000100:00100000:3.0:1789265653.250197:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789265653.250206:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417628672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265653.250236:0:23784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789265653.250290:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417628672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265653.250297:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789265653.250373:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417628672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265653.258071:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417628800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265653.258139:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265653.258241:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417628800 00000100:00100000:3.0:1789265653.258250:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417628800 00000100:00100000:3.0:1789265653.258303:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789265653.258311:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417628800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265653.258341:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265653.258387:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417628800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265653.258394:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789265653.258493:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417628800:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789265653.633316:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265654.657363:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265655.681301:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265656.001746:0:22793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789265656.711338:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265657.735134:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265658.369260:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417628928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265658.369331:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265658.369443:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265658.369450:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417629056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265658.369478:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265658.369559:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417629056 00000100:00100000:2.0:1789265658.369567:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417629056 00000100:00100000:2.0:1789265658.369631:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265658.369641:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417629056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265658.369678:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789265658.369724:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417629056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265658.369731:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789265658.369789:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb84844380 x1876180417629056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265658.369807:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417629056:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789265658.369864:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265658.369868:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789265658.369871:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789265658.369874:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789265658.369886:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417628928 00000100:00080000:2.0:1789265658.369891:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1789265658.369893:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417628928 00000100:00080000:2.0:1789265658.369896:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789265658.369901:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcca789a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789265658.369906:0:17249:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 704 00000100:00080000:2.0:1789265658.369911:0:17249:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789265658.369916:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fcca789a800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265658.369933:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789265658.369938:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83e98380 x1876180417629568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789265658.369946:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417628928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265658.369975:0:22765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789265658.370018:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417628928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265658.370054:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789265658.370077:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417629568:0@lo:8:kworker.0 00000100:00100000:0.0:1789265658.370106:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789265658.370131:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265658.370548:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417629184:0@lo:400:kworker.0 00000100:00100000:2.0:1789265658.370582:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265658.370748:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417629824:0@lo:400:kworker.0 00000100:00100000:2.0:1789265658.370786:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265658.370815:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789265658.370821:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83d46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417629312:0@lo:400:kworker.0 00000100:00100000:2.0:1789265658.370842:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265658.370857:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417629952:0@lo:400:kworker.0 00000100:00100000:2.0:1789265658.370874:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265658.370914:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417629568 00000100:00100000:2.0:1789265658.370918:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417629568 00000100:00100000:2.0:1789265658.370939:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265658.370950:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1876180417629568:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789265658.370968:0:24265:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789265658.371015:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1876180417629568:12345-0@lo:8:kworker.0 Request processed in 69us (908us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789265658.371088:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265658.371115:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417629824 00000100:00100000:2.0:1789265658.371119:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417629824 00000100:00100000:2.0:1789265658.371149:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417629952 00000100:00100000:2.0:1789265658.371152:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417629952 00000100:00100000:2.0:1789265658.371166:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265658.371172:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417629824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265658.371224:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417629824:12345-0@lo:400:kworker.0 Request processed in 52us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265658.371231:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265658.371243:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265658.371249:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417629952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265658.371274:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417629952:12345-0@lo:400:kworker.0 Request processed in 25us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265658.371280:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265658.371304:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417629312 00000100:00100000:2.0:1789265658.371307:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417629312 00000100:00100000:2.0:1789265658.371341:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789265658.371348:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417629312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265658.371380:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417629312:12345-0@lo:400:kworker.0 Request processed in 32us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265658.371386:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1789265658.371438:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcca789a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789265658.371444:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789265658.371447:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417629568:0@lo:8:kworker.0 00000100:00080000:2.0:1789265658.371470:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265658.371473:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265658.371490:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417629312:0@lo:400:kworker.0 00010000:00080000:2.0:1789265658.371502:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83e9aa00 x1876180417629952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265658.371512:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417629952:0@lo:400:kworker.0 00010000:00080000:2.0:1789265658.371521:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83e9ad80 x1876180417629824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265658.371529:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417629824:0@lo:400:kworker.0 00000100:00100000:2.0:1789265658.371553:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417629440:0@lo:400:kworker.0 00000100:00100000:2.0:1789265658.371576:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265658.371606:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417628928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265658.371618:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265658.371623:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417629696:0@lo:400:kworker.0 00000100:00100000:2.0:1789265658.371652:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265658.371672:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417629440 00000100:00100000:2.0:1789265658.371676:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417629440 00000100:00100000:2.0:1789265658.371693:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417629696 00000100:00100000:2.0:1789265658.371695:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417629696 00000100:00100000:2.0:1789265658.371707:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265658.371712:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417629440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265658.371743:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417629440:12345-0@lo:400:kworker.0 Request processed in 30us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265658.371749:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265658.371761:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265658.371766:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417629696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265658.371809:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417629696:12345-0@lo:400:kworker.0 Request processed in 43us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265658.371815:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789265658.371839:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83e9bb80 x1876180417629696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265658.371848:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417629696:0@lo:400:kworker.0 00010000:00080000:2.0:1789265658.371859:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83e9b100 x1876180417629440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265658.371868:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417629440:0@lo:400:kworker.0 00000100:00100000:1.0:1789265658.372119:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417629184 00000100:00100000:1.0:1789265658.372124:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417629184 00000100:00100000:1.0:1789265658.372166:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789265658.372175:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+21:3641:x1876180417629184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265658.372623:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+21:3641:x1876180417629184:12345-0@lo:400:kworker.0 Request processed in 448us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265658.372630:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789265658.372695:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417629184:0@lo:400:kworker.0 00000100:00100000:2.0:1789265658.375001:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417630080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265658.375531:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265658.375612:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417630080 00000100:00100000:3.0:1789265658.375620:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417630080 00000100:00100000:3.0:1789265658.376852:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789265658.376865:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417630080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265658.376902:0:23784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265658.376968:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417630080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265658.376975:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789265658.377083:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417630080:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789265658.758310:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789265659.136762:0:25079:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789265659.136775:0:25079:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789265659.136776:0:25079:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789265659.136894:0:25079:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fcb82c56000 00000020:01000004:2.0:1789265659.136908:0:25079:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000040:00080000:3.0:1789265659.137688:0:23512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1789265659.140871:0:25079:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789265659.142093:0:25079:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fccbd37b370) 00000020:00000080:3.0:1789265659.142122:0:25079:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789265659.249704:0:25079:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789265659.250410:0:25079:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789265659.250654:0:25079:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789265659.251217:0:25079:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789265659.251536:0:25079:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789265659.252136:0:25079:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789265659.252432:0:25079:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1789265659.256348:0:25079:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789265659.256557:0:25079:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789265659.256572:0:25079:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789265659.256595:0:25079:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9272d942b4a98288 00000020:01000004:3.0:1789265659.256603:0:25079:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789265659.256625:0:25079:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.149@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789265659.256628:0:25079:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.149@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789265659.256634:0:25079:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789265659.256678:0:25079:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789265659.256683:0:25079:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.149@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789265659.268971:0:25079:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.149@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789265659.269010:0:25079:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.149@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789265659.269014:0:25079:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789265659.269016:0:25079:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789265659.269017:0:25079:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265659.269019:0:25079:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265659.269020:0:25079:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265659.269135:0:25079:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265659.269137:0:25079:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265659.269139:0:25079:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265659.269140:0:25079:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789265659.269144:0:25079:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789265659.269146:0:25079:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789265659.269147:0:25079:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789265659.269149:0:25079:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789265659.269150:0:25079:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789265659.269151:0:25079:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789265659.269152:0:25079:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789265659.269153:0:25079:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789265659.269154:0:25079:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789265659.269155:0:25079:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789265659.269180:0:25079:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789265659.269265:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e9bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417630208:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789265659.269353:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265659.269441:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0a7e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789265659.269521:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417630208 00000100:00100000:3.0:1789265659.269531:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417630208 00000100:00100000:3.0:1789265659.269614:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789265659.269624:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+21:25079:x1876180417630208:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789265659.269653:0:22754:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789265659.269656:0:22754:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789265659.269660:0:22754:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789265659.269969:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+21:25079:x1876180417630208:12345-0@lo:253:mount.lustre.0 Request processed in 345us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.269978:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789265659.270072:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e9bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417630208:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789265659.270082:0:25079:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789265659.270085:0:25079:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789265659.270086:0:25079:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789265659.270088:0:25079:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789265659.270089:0:25079:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789265659.270090:0:25079:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789265659.270092:0:25079:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789265659.270093:0:25079:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789265659.270094:0:25079:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789265659.270095:0:25079:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789265659.270116:0:25079:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fcb82c56000 from lustre-OST0001 10000000:01000000:0.0:1789265659.270145:0:25079:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789265659.270149:0:25079:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789265659.270156:0:25079:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fccb09b3370 local copy 00010000:00010000:0.0:1789265659.270166:0:25079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a97fa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fa9 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265659.270256:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417630336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265659.270284:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265659.270756:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99137840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265659.270833:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417630336 00000100:00100000:2.0:1789265659.270838:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417630336 00000100:00100000:2.0:1789265659.270872:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789265659.270892:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+21:25079:x1876180417630336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265659.270968:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+21:25079:x1876180417630336:12345-0@lo:501:mount.lustre.0 Request processed in 88us (682us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789265659.270975:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789265659.271059:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417630336:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789265659.271074:0:25079:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.149@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789265659.271091:0:25079:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.149@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789265659.271098:0:25079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a97fa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fa9 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.271107:0:25079:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff000/0x9272d942b4a97fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a97fa9 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265659.271132:0:25079:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fcb82c56000 10000000:01000000:0.0:1789265659.271143:0:25079:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789265659.271149:0:25079:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789265659.271151:0:25079:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789265659.271156:0:25079:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789265659.271159:0:25079:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789265659.271194:0:25079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a9828f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.271202:0:25079:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a9828f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.271211:0:25079:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a9828f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265659.271224:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417630464:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789265659.271251:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265659.271271:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99137840 going to sleep for 11 seconds 00000100:00100000:2.0:1789265659.271695:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417630464 00000100:00100000:2.0:1789265659.271701:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417630464 00000100:00100000:2.0:1789265659.271723:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789265659.271729:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+21:25079:x1876180417630464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265659.271738:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265659.271750:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2fc00/0x9272d942b4a98296 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9828f expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.271778:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2fc00/0x9272d942b4a98296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9828f expref: 22 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.271788:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb84a2fc00/0x9272d942b4a98296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9828f expref: 22 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.271796:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb84a2fc00, rc 0) 00000100:00100000:2.0:1789265659.271826:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+22:25079:x1876180417630464:12345-0@lo:101:mount.lustre.0 Request processed in 97us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.271832:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789265659.271912:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417630464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789265659.271926:0:25079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a9828f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98296 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265659.271934:0:25079:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a9828f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a98296 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789265659.273463:0:25079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1789265659.274222:0:25079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789265659.276689:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789265659.276734:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1789265659.276749:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1789265659.276761:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1789265659.276796:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1789265659.276810:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1789265659.276825:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1789265659.276837:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1789265659.276849:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1789265659.276873:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1789265659.277306:0:25079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1789265659.277678:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417630592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265659.277746:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265659.277830:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99137540 going to sleep for 11 seconds 00000100:00100000:2.0:1789265659.277873:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417630592 00000100:00100000:2.0:1789265659.277946:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417630592 00000100:00100000:2.0:1789265659.278087:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789265659.278098:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+22:25079:x1876180417630592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265659.278250:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+22:25079:x1876180417630592:12345-0@lo:501:mount.lustre.0 Request processed in 153us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.278266:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789265659.278357:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417630592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789265659.278388:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417630720:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789265659.278426:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265659.279020:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99137540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265659.279079:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417630720 00000100:00100000:3.0:1789265659.279084:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417630720 00000100:00100000:3.0:1789265659.279112:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789265659.279118:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+22:25079:x1876180417630720:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265659.279936:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+22:25079:x1876180417630720:12345-0@lo:503:mount.lustre.0 Request processed in 815us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.279946:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789265659.280636:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417630720:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789265659.281390:0:25079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789265659.281723:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417630848:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265659.281794:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265659.281893:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99137840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265659.281987:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417630848 00000100:00100000:3.0:1789265659.281994:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417630848 00000100:00100000:3.0:1789265659.282324:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789265659.282335:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+22:25079:x1876180417630848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265659.283079:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+22:25079:x1876180417630848:12345-0@lo:502:mount.lustre.0 Request processed in 744us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.283088:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789265659.283207:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417630848:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789265659.283410:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789265659.283440:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1789265659.283455:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1789265659.283469:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1789265659.283481:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1789265659.283493:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1789265659.283505:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1789265659.283529:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1789265659.283542:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1789265659.283569:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417630976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789265659.283624:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265659.286896:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99137840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265659.287090:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417630976 00000100:00100000:1.0:1789265659.287099:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417630976 00000100:00100000:3.0:1789265659.287185:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789265659.287268:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+22:25079:x1876180417630976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265659.287501:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+22:25079:x1876180417630976:12345-0@lo:502:mount.lustre.0 Request processed in 236us (3876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265659.287557:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417630976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789265659.287647:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1789265659.287662:0:25079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1789265659.290399:0:25083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789265659.290411:0:25083:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1789265659.290418:0:25083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265659.290421:0:25083:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789265659.290428:0:25083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789265659.290443:0:25083:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fccbf4599b8) 00000020:00000080:0.0:1789265659.290469:0:25083:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789265659.290476:0:25083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789265659.290561:0:25083:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fcb82c56000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789265659.290571:0:25083:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789265659.290776:0:25083:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9272d942b4a982a4 00000100:00100000:3.0:1789265659.294968:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00010000:0.0:1789265659.295700:0:25083:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1789265659.297283:0:25083:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:0.0:1789265659.299457:0:25083:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1789265659.301645:0:25083:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789265659.301659:0:25083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265659.301666:0:25083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265659.301668:0:25083:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789265659.301673:0:25083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265659.301677:0:25083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265659.301679:0:25083:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789265659.301682:0:25083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789265659.301684:0:25083:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789265659.301697:0:25083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265659.301700:0:25083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265659.301702:0:25083:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789265659.301704:0:25083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789265659.301707:0:25083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265659.301708:0:25083:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789265659.301711:0:25083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789265659.301739:0:25083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789265659.301742:0:25083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789265659.301743:0:25083:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789265659.301747:0:25083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1789265659.303490:0:25079:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789265659.303532:0:25079:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789265659.303557:0:25079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a9828f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98296 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.303568:0:25079:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5800/0x9272d942b4a9828f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98296 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265659.303575:0:25079:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fcb82c56000 from 1 10000000:01000000:2.0:1789265659.303670:0:25079:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265659.303708:0:25079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a982ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.303716:0:25079:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a982ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.303728:0:25079:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a982ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265659.303752:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417631104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265659.304261:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265659.304404:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0a7e000 going to sleep for 11 seconds 00000100:00100000:1.0:1789265659.304508:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417631104 00000100:00100000:1.0:1789265659.304516:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417631104 00000100:00100000:1.0:1789265659.304666:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789265659.304678:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+22:25079:x1876180417631104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789265659.304695:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265659.304713:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a982b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a982ab expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265659.304757:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a982b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a982ab expref: 23 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265659.304781:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a982b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a982ab expref: 23 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265659.304790:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccbd2fe000, rc 0) 00000100:00100000:1.0:1789265659.304843:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+23:25079:x1876180417631104:12345-0@lo:101:mount.lustre.0 Request processed in 167us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265659.304850:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789265659.304934:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417631104:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265659.304949:0:25079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a982ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a982b2 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.304958:0:25079:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a982ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a982b2 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265659.308442:0:25079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1789265659.308752:0:25079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789265659.309411:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789265659.309440:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1789265659.309456:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1789265659.309472:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1789265659.309486:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1789265659.309499:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1789265659.309512:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1789265659.309525:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1789265659.309539:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1789265659.309553:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1789265659.309567:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1789265659.309973:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1789265659.309982:0:25079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1789265659.310088:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417631232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265659.310160:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.314756:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265659.315084:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417631232 00000100:00100000:2.0:1789265659.315093:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417631232 00000100:00100000:2.0:1789265659.315136:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789265659.315145:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+23:25079:x1876180417631232:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265659.315483:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+23:25079:x1876180417631232:12345-0@lo:501:mount.lustre.0 Request processed in 337us (5322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.315502:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789265659.315603:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417631232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265659.315655:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417631360:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265659.315704:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.315735:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265659.315848:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417631360 00000100:00100000:2.0:1789265659.315853:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417631360 00000100:00100000:2.0:1789265659.315873:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789265659.315889:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+23:25079:x1876180417631360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265659.315980:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+23:25079:x1876180417631360:12345-0@lo:503:mount.lustre.0 Request processed in 100us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.315988:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789265659.316156:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417631360:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789265659.316749:0:25079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789265659.316824:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417631488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265659.316867:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.316961:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265659.317056:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417631488 00000100:00100000:2.0:1789265659.317062:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417631488 00000100:00100000:2.0:1789265659.317088:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789265659.317095:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+23:25079:x1876180417631488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265659.317183:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+23:25079:x1876180417631488:12345-0@lo:502:mount.lustre.0 Request processed in 87us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.317267:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789265659.317484:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417631488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265659.317721:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789265659.317758:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1789265659.317799:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1789265659.317815:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1789265659.317828:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1789265659.317842:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1789265659.317856:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789265659.317870:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1789265659.317955:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1789265659.317974:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1789265659.317987:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1789265659.318011:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417631616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265659.318079:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.318104:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789265659.318278:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417631616 00000100:00100000:2.0:1789265659.318284:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417631616 00000100:00100000:2.0:1789265659.318399:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789265659.318408:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+23:25079:x1876180417631616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265659.318499:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+23:25079:x1876180417631616:12345-0@lo:502:mount.lustre.0 Request processed in 92us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.318507:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789265659.318659:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417631616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789265659.318704:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1789265659.318712:0:25079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789265659.319671:0:25087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265659.319682:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.319684:0:25087:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789265659.319691:0:25087:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fcb82c56000 00000020:00000080:3.0:1789265659.319693:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265659.319702:0:25087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265659.319705:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.319706:0:25087:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789265659.319709:0:25087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265659.319711:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.319712:0:25087:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789265659.319716:0:25087:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fcb82c56000 00000020:00000080:3.0:1789265659.319718:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265659.319793:0:25087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265659.319797:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.319805:0:25087:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789265659.319809:0:25087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265659.319811:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.319813:0:25087:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789265659.319817:0:25087:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fcb82c56000 00000020:00000080:3.0:1789265659.319819:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265659.319839:0:25087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265659.319842:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.319843:0:25087:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789265659.319846:0:25087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789265659.319848:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.319850:0:25087:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789265659.319853:0:25087:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fcb82c56000 00000020:00000080:3.0:1789265659.319855:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789265659.319876:0:25087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789265659.319947:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789265659.319950:0:25087:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789265659.319953:0:25087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1789265659.320120:0:25079:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789265659.320150:0:25079:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265659.320173:0:25079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a982ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a982b2 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.320293:0:25079:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a982ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a982b2 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265659.320412:0:25079:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789265659.320415:0:25079:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fcb82c56000 10000000:01000000:2.0:1789265659.320419:0:25079:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fcb82c56000 10000000:01000000:2.0:1789265659.320423:0:25079:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789265659.320429:0:25079:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fcb82c56000 from 1 10000000:01000000:2.0:1789265659.320431:0:25079:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789265659.320461:0:25079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a982b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.320470:0:25079:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a982b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.320479:0:25079:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a982b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265659.320499:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417631744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789265659.320552:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.320662:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417631744 00000100:00100000:3.0:1789265659.320670:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417631744 00000100:00100000:3.0:1789265659.320713:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789265659.320725:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+23:25079:x1876180417631744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789265659.320738:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265659.320751:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f53600/0x9272d942b4a982c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a982b9 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.320788:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f53600/0x9272d942b4a982c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a982b9 expref: 24 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.320799:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f53600/0x9272d942b4a982c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a982b9 expref: 24 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.320821:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f53600, rc 0) 00000100:00100000:3.0:1789265659.320856:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+24:25079:x1876180417631744:12345-0@lo:101:mount.lustre.0 Request processed in 133us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.320863:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789265659.321002:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789265659.321053:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417631744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789265659.321066:0:25079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a982b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a982c0 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.321076:0:25079:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a982b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a982c0 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789265659.323679:0:25079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1789265659.324808:0:25079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789265659.325857:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1789265659.326410:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1789265659.326433:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1789265659.326448:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1789265659.326463:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1789265659.326477:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1789265659.326495:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1789265659.326511:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1789265659.326527:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1789265659.326542:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1789265659.326557:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1789265659.326572:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1789265659.326967:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1789265659.326987:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1789265659.327002:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1789265659.327015:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1789265659.327405:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1789265659.327423:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1789265659.327433:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1789265659.327445:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1789265659.327456:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1789265659.327469:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1789265659.327481:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1789265659.327493:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1789265659.327520:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1789265659.327532:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1789265659.327542:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1789265659.327553:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1789265659.327563:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1789265659.327658:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1789265659.327675:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1789265659.327688:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1789265659.327700:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1789265659.327713:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1789265659.327728:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1789265659.327742:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1789265659.327755:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1789265659.327779:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1789265659.327795:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1789265659.327809:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1789265659.327836:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1789265659.327853:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1789265659.327866:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1789265659.327948:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1789265659.327970:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1789265659.327983:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1789265659.327995:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1789265659.328008:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1789265659.328183:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1789265659.329728:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1789265659.329759:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1789265659.329764:0:25079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1789265659.329960:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417631872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265659.330085:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265659.330466:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265659.335728:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417631872 00000100:00100000:3.0:1789265659.335742:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417631872 00000100:00100000:3.0:1789265659.342507:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789265659.342522:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+24:25079:x1876180417631872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789265659.342780:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+24:25079:x1876180417631872:12345-0@lo:501:mount.lustre.0 Request processed in 261us (12694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.342789:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789265659.344119:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417631872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789265659.344172:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417632000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789265659.344697:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265659.344745:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13840 going to sleep for 11 seconds 00000100:00100000:3.0:1789265659.345760:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417632000 00000100:00100000:3.0:1789265659.345780:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417632000 00000100:00100000:3.0:1789265659.345832:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789265659.345842:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+24:25079:x1876180417632000:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789265659.345971:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+24:25079:x1876180417632000:12345-0@lo:503:mount.lustre.0 Request processed in 130us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.345979:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789265659.346366:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417632000:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789265659.347714:0:25079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789265659.347821:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417632128:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265659.347881:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265659.347921:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc88495600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265659.347944:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417632128 00000100:00100000:2.0:1789265659.347950:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417632128 00000100:00100000:2.0:1789265659.347985:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789265659.347994:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+24:25079:x1876180417632128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265659.348112:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+24:25079:x1876180417632128:12345-0@lo:502:mount.lustre.0 Request processed in 119us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.348119:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789265659.348161:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417632128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265659.349499:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1789265659.349533:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1789265659.349546:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1789265659.349560:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1789265659.349575:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1789265659.349699:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1789265659.349714:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1789265659.349727:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1789265659.349739:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1789265659.349750:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1789265659.349762:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1789265659.349788:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1789265659.349801:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1789265659.349815:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1789265659.349830:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1789265659.349867:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1789265659.349883:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1789265659.349897:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1789265659.349911:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1789265659.349922:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1789265659.349933:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1789265659.349944:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1789265659.349957:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1789265659.349972:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1789265659.349985:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1789265659.349998:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1789265659.350011:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1789265659.351296:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1789265659.351399:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1789265659.351416:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1789265659.351430:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1789265659.351457:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1789265659.351474:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1789265659.351487:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1789265659.351500:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1789265659.351513:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1789265659.351524:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1789265659.351537:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1789265659.351550:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1789265659.351563:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1789265659.351576:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1789265659.351845:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1789265659.351862:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1789265659.351877:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1789265659.351892:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1789265659.351905:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1789265659.351918:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1789265659.351946:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1789265659.352013:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417632256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265659.352730:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265659.352784:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc88495600 going to sleep for 11 seconds 00000100:00100000:3.0:1789265659.352841:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417632256 00000100:00100000:3.0:1789265659.352849:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417632256 00000100:00100000:3.0:1789265659.352900:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789265659.352909:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+24:25079:x1876180417632256:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789265659.353044:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+24:25079:x1876180417632256:12345-0@lo:502:mount.lustre.0 Request processed in 115us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.353052:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789265659.353153:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417632256:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265659.353520:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1789265659.353546:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1789265659.353573:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417632384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265659.354389:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265659.354418:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc88495600 going to sleep for 11 seconds 00000100:00100000:2.0:1789265659.354443:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417632384 00000100:00100000:2.0:1789265659.354448:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417632384 00000100:00100000:2.0:1789265659.354481:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789265659.354489:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+24:25079:x1876180417632384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789265659.354727:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+24:25079:x1876180417632384:12345-0@lo:502:mount.lustre.0 Request processed in 237us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.354734:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789265659.354785:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417632384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789265659.354836:0:25079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1789265659.354846:0:25079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789265659.358391:0:25092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789265659.358412:0:25092:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fcb829fb370) 00000020:00000080:2.0:1789265659.358439:0:25092:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789265659.358526:0:25092:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fcb82c56000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789265659.358530:0:25092:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fcb82c56000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789265659.358533:0:25092:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fcb82c56000 3 00010000:00080000:2.0:1789265659.358564:0:25092:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcb83eaf000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.149@tcp at head 00010000:00010000:3.0:1789265659.360734:0:25092:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1789265659.360999:0:25092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789265659.361067:0:25092:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789265659.361079:0:25092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9272d942b4a982ce 00000100:00080000:3.0:1789265659.361089:0:25092:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789265659.361094:0:25092:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fcb83eaf000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:3.0:1789265659.361129:0:25092:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb8495ed80 x1876180417632512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265659.361166:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876180417632512:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789265659.361377:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.361440:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417632512 00000100:00100000:3.0:1789265659.361446:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417632512 00000100:00100000:3.0:1789265659.361479:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789265659.361487:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1876180417632512:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789265659.361509:0:22760:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 710 last 0 00000020:00000080:3.0:1789265659.361541:0:22760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9272d942b4a982d5 00000004:00100000:3.0:1789265659.361555:0:22760:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789265659.361657:0:22760:0:(import.c:65:import_set_state_nolock()) ffff9fcb84a59000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789265659.361775:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876180417632512:12345-0@lo:38:llog_process_th.0 Request processed in 273us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.361784:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789265659.361806:0:25092:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789265659.361847:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265659.361851:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265659.361853:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265659.361856:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265659.361901:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265659.361904:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789265659.361906:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcca789a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265659.361910:0:17249:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 709 00000100:00080000:3.0:1789265659.361914:0:17249:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789265659.361917:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fcca789a800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:3.0:1789265659.361932:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83da9880 x1876180417633152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789265659.361991:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417632640:0@lo:400:kworker.0 00000100:00100000:3.0:1789265659.362051:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.362070:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417633280:0@lo:400:kworker.0 00000100:00100000:3.0:1789265659.362097:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.362116:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265659.362122:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417633024:0@lo:400:kworker.0 00000100:00100000:3.0:1789265659.362154:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789265659.362198:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb8495ed80 x1876180417632512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265659.362208:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789265659.362216:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1789265659.362224:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789265659.362227:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789265659.362230:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb83eaf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789265659.362235:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876180417632512:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789265659.362255:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417633152:0@lo:8:kworker.0 00000100:00100000:3.0:1789265659.362262:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417632768:0@lo:400:kworker.0 00000100:00100000:0.0:1789265659.362282:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.362284:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.362300:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417633408:0@lo:400:kworker.0 00000100:00100000:3.0:1789265659.362394:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.362415:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789265659.362421:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417632896:0@lo:400:kworker.0 00000100:00100000:3.0:1789265659.362444:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.362460:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417633536:0@lo:400:kworker.0 00000100:00100000:3.0:1789265659.362483:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.362523:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417632640 00000100:00100000:3.0:1789265659.362527:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417632640 00000100:00100000:3.0:1789265659.362557:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417632896 00000100:00100000:3.0:1789265659.362561:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417632896 00000100:00100000:1.0:1789265659.362671:0:24771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417633024 00000100:00100000:1.0:1789265659.362676:0:24771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417633024 00000100:00100000:1.0:1789265659.362704:0:24771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417633152 00000100:00100000:1.0:1789265659.362707:0:24771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417633152 00000100:00100000:1.0:1789265659.362726:0:24771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265659.362734:0:24771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417633024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265659.362794:0:24771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417633024:12345-0@lo:400:kworker.0 Request processed in 62us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265659.362800:0:24771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789265659.362812:0:24771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265659.362816:0:24771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1876180417633152:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789265659.363305:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789265659.363423:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83dab800 x1876180417633024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265659.363429:0:24771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1876180417633152:12345-0@lo:8:kworker.0 Request processed in 609us (1144us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789265659.363446:0:24771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265659.363453:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417633024:0@lo:400:kworker.0 00000100:00100000:1.0:1789265659.363503:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265659.363508:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcca789a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265659.363513:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789265659.363522:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417633152:0@lo:8:kworker.0 00000100:00100000:3.0:1789265659.363657:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417632640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265659.363703:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417632640:12345-0@lo:400:kworker.0 Request processed in 50us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.363710:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789265659.363729:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265659.363731:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417632640:0@lo:400:kworker.0 00000100:00100000:3.0:1789265659.363739:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417632896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265659.363862:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417632896:12345-0@lo:400:kworker.0 Request processed in 125us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.363868:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789265659.363891:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417633280 00000100:00100000:3.0:1789265659.363896:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417633280 00000100:00100000:3.0:1789265659.363913:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417632768 00000100:00100000:3.0:1789265659.363916:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417632768 00000100:00100000:3.0:1789265659.363926:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417633408 00000100:00100000:3.0:1789265659.363929:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417633408 00000100:00100000:3.0:1789265659.363940:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417633536 00000100:00100000:3.0:1789265659.363942:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417633536 00000100:00100000:3.0:1789265659.363955:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265659.363962:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417633280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265659.363999:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876180417633280:12345-0@lo:400:kworker.0 Request processed in 38us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.364005:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789265659.364018:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265659.364043:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417632768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265659.364090:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417632768:12345-0@lo:400:kworker.0 Request processed in 67us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.364096:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789265659.364109:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789265659.364115:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417633408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265659.364140:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417633408:12345-0@lo:400:kworker.0 Request processed in 25us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.364145:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789265659.364154:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789265659.364159:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417633536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265659.364184:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417633536:12345-0@lo:400:kworker.0 Request processed in 24us (1701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.365416:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417632896:0@lo:400:kworker.0 00010000:00080000:2.0:1789265659.365432:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83da8a80 x1876180417633536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265659.365442:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417633536:0@lo:400:kworker.0 00010000:00080000:2.0:1789265659.365453:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83daa300 x1876180417632768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265659.365461:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417632768:0@lo:400:kworker.0 00010000:00080000:2.0:1789265659.365471:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83da9f80 x1876180417633408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265659.365479:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417633408:0@lo:400:kworker.0 00000100:00100000:3.0:1789265659.365564:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1789265659.365693:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83dabb80 x1876180417633280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265659.365703:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876180417633280:0@lo:400:kworker.0 00000020:01000004:2.0:1789265659.366143:0:25092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789265659.366158:0:25092:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9fcb83938000) 00000020:00000080:2.0:1789265659.366181:0:25092:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1789265659.366254:0:25092:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fcb82c56000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789265659.366258:0:25092:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fcb82c56000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789265659.366260:0:25092:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fcb82c56000 3 00010000:00080000:2.0:1789265659.366295:0:25092:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fcb83eac800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.149@tcp at head 00010000:00010000:0.0:1789265659.368156:0:25092:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1789265659.368342:0:25092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789265659.368391:0:25092:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789265659.368403:0:25092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x9272d942b4a982e3 00000100:00080000:0.0:1789265659.368412:0:25092:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789265659.368418:0:25092:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9fcb83eac800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:0.0:1789265659.368451:0:25092:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83f19180 x1876180417633664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789265659.368491:0:25092:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789265659.368713:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1876180417633664:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789265659.368857:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265659.368863:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789265659.368866:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265659.368869:0:17249:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789265659.368926:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.369090:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417633664 00000100:00100000:3.0:1789265659.369098:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417633664 00000100:00100000:3.0:1789265659.369133:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265659.369141:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876180417633664:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789265659.369174:0:22761:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 710 last 0 00000020:00000080:3.0:1789265659.369213:0:22761:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x9272d942b4a982ea 00000004:00100000:3.0:1789265659.369228:0:22761:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789265659.369257:0:22761:0:(import.c:65:import_set_state_nolock()) ffff9fcb84a5c000 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1789265659.369476:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fcb83f19180 x1876180417633664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789265669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265659.369486:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265659.369493:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1789265659.369500:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789265659.369503:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789265659.369506:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcb83eac800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789265659.369511:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1876180417633664:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789265659.369892:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876180417633664:12345-0@lo:38:llog_process_th.0 Request processed in 164us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.369902:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:1.0:1789265659.372209:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1789265659.372543:0:25079:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789265659.372575:0:25079:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789265659.372603:0:25079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a982b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a982c0 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.372615:0:25079:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2ee00/0x9272d942b4a982b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a982c0 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789265659.372662:0:25079:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789265659.372664:0:25079:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789265659.372666:0:25079:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265659.372667:0:25079:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265659.372668:0:25079:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265659.372670:0:25079:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265659.372671:0:25079:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265659.372673:0:25079:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265659.372675:0:25079:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789265659.372678:0:25079:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789265659.372681:0:25079:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789265659.372682:0:25079:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789265659.372683:0:25079:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265659.372684:0:25079:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265659.372685:0:25079:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265659.372686:0:25079:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265659.372688:0:25079:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265659.372689:0:25079:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265659.372693:0:25079:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789265659.372717:0:25079:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789265659.372735:0:25079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dabb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417633792:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789265659.372809:0:25079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.372844:0:25079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc8151ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265659.372868:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417633792 00000100:00100000:3.0:1789265659.372875:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417633792 00000100:00100000:3.0:1789265659.372914:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789265659.372923:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+24:25079:x1876180417633792:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789265659.372947:0:22754:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789265659.372961:0:22754:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789265659.374923:0:22754:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789265659.374940:0:22754:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789265659.374964:0:22775:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789265659.374971:0:22775:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789265659.374995:0:22775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a982f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.375180:0:22775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a98265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9825e expref: 24 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.375189:0:22775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb84a2f000/0x9272d942b4a98273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9826c expref: 24 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.375196:0:22775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a982f1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.375278:0:22775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb84a2f000/0x9272d942b4a98273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a9826c expref: 24 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.375292:0:22775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb84a2f000/0x9272d942b4a98273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a9826c expref: 24 pid: 22752 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265659.375305:0:22775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22775:1876180417633920:0@lo:104: 00000100:00100000:3.0:1789265659.375526:0:22775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789265659.375654:0:22775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a98265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a9825e expref: 24 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265659.375662:0:22775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a98265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a9825e expref: 24 pid: 22753 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265659.375671:0:22775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22775:1876180417634048:0@lo:104: 00000100:00100000:3.0:1789265659.375696:0:22775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.375949:0:22775:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99449b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789265659.376007:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+24:25079:x1876180417633792:12345-0@lo:253:mount.lustre.0 Request processed in 3085us (3197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265659.376051:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789265659.376106:0:25079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dabb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82fe313a-a4f8-4781-be1f-82c20160e337:25079:1876180417633792:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789265659.376116:0:25079:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789265659.376120:0:25079:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789265659.376121:0:25079:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789265659.376123:0:25079:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789265659.376124:0:25079:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789265659.376125:0:25079:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789265659.376126:0:25079:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789265659.376128:0:25079:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789265659.376129:0:25079:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789265659.376131:0:25079:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789265659.376144:0:25079:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789265659.377149:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417633920 00000100:00100000:1.0:1789265659.377157:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417633920 00000100:00100000:1.0:1789265659.377200:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417634048 00000100:00100000:1.0:1789265659.377203:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417634048 00000100:00100000:1.0:1789265659.377218:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265659.377225:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:82fe313a-a4f8-4781-be1f-82c20160e337+4:22775:x1876180417633920:12345-0@lo:104: 00010000:00010000:1.0:1789265659.377238:0:22743:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4e00/0x9272d942b4a9826c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a98273 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265659.377291:0:22743:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789265659.377297:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:82fe313a-a4f8-4781-be1f-82c20160e337+4:22775:x1876180417633920:12345-0@lo:104: Request processed in 73us (1771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265659.377303:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265659.377808:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265659.377818:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83daad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82fe313a-a4f8-4781-be1f-82c20160e337+4:22775:x1876180417634048:12345-0@lo:104: 00010000:00010000:2.0:1789265659.377828:0:22742:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a9825e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a98265 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.377870:0:22742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789265659.377876:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83daad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82fe313a-a4f8-4781-be1f-82c20160e337+4:22775:x1876180417634048:12345-0@lo:104: Request processed in 61us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.377893:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789265659.377915:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265659.377921:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4e00/0x9272d942b4a9826c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a98273 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.377929:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4e00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265659.377933:0:22747:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4e00/0x9272d942b4a9826c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a98273 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.377942:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4e00/0x9272d942b4a9826c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a98273 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265659.377960:0:22747:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4e00/0x9272d942b4a9826c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a98273 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265659.377965:0:22747:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265659.378003:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4e00/0x9272d942b4a9826c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98273 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.378009:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265659.378044:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4e00/0x9272d942b4a9826c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98273 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.378052:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83da4e00/0x9272d942b4a9826c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98273 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.378062:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265659.378065:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a9825e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a98265 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.378070:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e800 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265659.378073:0:22747:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a9825e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a98265 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.378078:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a9825e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a98265 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265659.378084:0:22747:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a9825e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a98265 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265659.378088:0:22747:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789265659.378109:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a9825e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98265 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.378115:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265659.378122:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a9825e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98265 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.378139:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e800/0x9272d942b4a9825e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98265 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265659.378149:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265659.378152:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265659.378154:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265659.378155:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265659.378174:0:22775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22775:1876180417633920:0@lo:104: 00000100:00100000:1.0:1789265659.378184:0:22775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22775:1876180417634048:0@lo:104: 00010000:00010000:1.0:1789265659.378205:0:22775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a982f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265659.378793:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82fe313a-a4f8-4781-be1f-82c20160e337:3643:1876180417634176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265659.378833:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.378873:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265659.378950:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417634176 00000100:00100000:2.0:1789265659.378956:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417634176 00010000:00010000:2.0:1789265659.378976:0:22744:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb84a2f000/0x9272d942b4a98273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9826c expref: 24 pid: 22752 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265659.378999:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265659.379005:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82fe313a-a4f8-4781-be1f-82c20160e337+24:3643:x1876180417634176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265659.379014:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265659.379019:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb84a2f000/0x9272d942b4a98273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9826c expref: 24 pid: 22752 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.379047:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb84a2f000/0x9272d942b4a98273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a9826c expref: 24 pid: 22752 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.379062:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb84a2f000/0x9272d942b4a98273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a9826c expref: 24 pid: 22752 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.379073:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265659.379107:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82fe313a-a4f8-4781-be1f-82c20160e337+23:3643:x1876180417634176:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.379113:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789265659.379175:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82fe313a-a4f8-4781-be1f-82c20160e337:3643:1876180417634304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265659.379199:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265659.379225:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82fe313a-a4f8-4781-be1f-82c20160e337:3643:1876180417634176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265659.380120:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417634304 00000100:00100000:2.0:1789265659.380126:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417634304 00010000:00010000:2.0:1789265659.380146:0:22746:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a98265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9825e expref: 23 pid: 22753 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265659.380210:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789265659.380218:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82fe313a-a4f8-4781-be1f-82c20160e337+23:3643:x1876180417634304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789265659.380228:0:22746:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265659.380232:0:22746:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a98265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a9825e expref: 23 pid: 22753 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.380242:0:22746:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a98265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a9825e expref: 23 pid: 22753 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.380255:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83da4000/0x9272d942b4a98265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a9825e expref: 23 pid: 22753 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.380267:0:22746:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a982f1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.380275:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a982f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789265659.380287:0:22746:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009766829s 00010000:00010000:2.0:1789265659.380292:0:22746:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a982f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.380298:0:22746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a982f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.380312:0:22746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a982f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.380319:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a982f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.380325:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265659.380329:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a982f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.380336:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a982f1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.380354:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a982f1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265659.380363:0:22746:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265659.380401:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82fe313a-a4f8-4781-be1f-82c20160e337+22:3643:x1876180417634304:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265659.380407:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789265659.380545:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82fe313a-a4f8-4781-be1f-82c20160e337:3643:1876180417634304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265659.380670:0:22775:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a982f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265659.380678:0:22775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a982f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265659.380684:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb84a2f200/0x9272d942b4a982f1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1789265659.383538:0:25079:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1789265659.390716:0:25079:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789265659.390724:0:25079:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789265659.390754:0:25079:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789265659.390807:0:25079:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.149@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789265659.390830:0:25079:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789265659.390855:0:25079:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789265659.391557:0:25079:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265659.391800:0:25079:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789265659.777213:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789265660.228005:0:25146:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265660.228979:0:25146:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789265660.417408:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265638/real 1789265638] req@ffff9fcb83c99f80 x1876180417619712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265658 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265660.417440:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83c99f80 x1876180417619712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265658 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265660.417451:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789265638/real 1789265638] req@ffff9fcb83c9ad80 x1876180417619840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265658 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265660.417462:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fcb83c9ad80 x1876180417619840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789265658 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789265660.417479:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcc82d4e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265660.421269:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789265660.421287:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417619712:0@lo:8:kworker.0 00000100:00080000:1.0:1789265660.421309:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccb4fdb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789265660.421317:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789265660.421321:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417619840:0@lo:8:kworker.0 00000100:00080000:3.0:1789265660.424930:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265660.424941:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789265660.424944:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcc82d4e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265660.424951:0:17249:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 690 00000100:00080000:3.0:1789265660.424956:0:17249:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789265660.424963:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fcc82d4e000 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:3.0:1789265660.424985:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83daa300 x1876180417634688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265660.425003:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265660.425006:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789265660.425008:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fccb4fdb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265660.425012:0:17249:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 690 00000100:00080000:3.0:1789265660.425014:0:17249:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789265660.425097:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fccb4fdb800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:3.0:1789265660.425112:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcb83da8a80 x1876180417634816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789265660.425145:0:17249:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789265660.425148:0:17249:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789265660.425149:0:17249:0:(import.c:65:import_set_state_nolock()) ffff9fcca789a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789265660.425154:0:17249:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fcca789a800 using connection 192.168.203.149@tcp/0@lo 00000100:00100000:3.0:1789265660.425165:0:17249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fcc837e2680 x1876180417635328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789265660.426140:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417634432:0@lo:400:kworker.0 00000100:00100000:2.0:1789265660.426210:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265660.426252:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417635200:0@lo:400:kworker.0 00000100:00100000:2.0:1789265660.426277:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265660.426295:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417635840:0@lo:400:kworker.0 00000100:00100000:2.0:1789265660.426335:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265660.426367:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789265660.426374:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417634560:0@lo:400:kworker.0 00000100:00100000:2.0:1789265660.426398:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265660.426418:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417635456:0@lo:400:kworker.0 00000100:00100000:2.0:1789265660.426438:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265660.426457:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417635968:0@lo:400:kworker.0 00000100:00100000:2.0:1789265660.426479:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265660.426510:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417635200 00000100:00100000:2.0:1789265660.426517:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417635200 00000100:00100000:2.0:1789265660.426570:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265660.426579:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417635200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265660.426626:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417635200:12345-0@lo:400:kworker.0 Request processed in 47us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265660.426633:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789265660.426655:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417635840 00000100:00100000:2.0:1789265660.426659:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417635840 00000100:00100000:2.0:1789265660.426679:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417635456 00000100:00100000:2.0:1789265660.426682:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417635456 00000100:00100000:2.0:1789265660.426693:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417635968 00000100:00100000:2.0:1789265660.426695:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417635968 00000100:00100000:2.0:1789265660.426709:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789265660.426716:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417635840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265660.426747:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876180417635840:12345-0@lo:400:kworker.0 Request processed in 32us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265660.426753:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789265660.426777:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789265660.426783:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417635456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265660.426819:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417635456:12345-0@lo:400:kworker.0 Request processed in 36us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265660.426825:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789265660.426838:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265660.426844:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417635968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265660.426869:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417635968:12345-0@lo:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265660.426875:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789265660.426893:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417634560 00000100:00100000:2.0:1789265660.426897:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417634560 00000100:00100000:2.0:1789265660.426921:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265660.426927:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417634560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265660.426959:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417634560:12345-0@lo:400:kworker.0 Request processed in 32us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265660.426965:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1789265660.426984:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265660.426988:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265660.426990:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265660.428116:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417634560:0@lo:400:kworker.0 00010000:00080000:2.0:1789265660.428145:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e1500 x1876180417635456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265660.428157:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417635456:0@lo:400:kworker.0 00010000:00080000:2.0:1789265660.428170:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e1c00 x1876180417635968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265660.428179:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417635968:0@lo:400:kworker.0 00010000:00080000:2.0:1789265660.428199:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83dab800 x1876180417635200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789265676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265660.428208:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417635200:0@lo:400:kworker.0 00010000:00080000:2.0:1789265660.428218:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e2d80 x1876180417635840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265660.428226:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876180417635840:0@lo:400:kworker.0 00000100:00100000:1.0:1789265660.428528:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417634688:0@lo:8:kworker.0 00000100:00100000:1.0:1789265660.428570:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265660.428604:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417634816:0@lo:8:kworker.0 00000100:00100000:1.0:1789265660.428627:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265660.428643:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417635328:0@lo:8:kworker.0 00000100:00100000:1.0:1789265660.428662:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265660.428693:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417634688 00000100:00100000:1.0:1789265660.428698:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417634688 00000100:00100000:1.0:1789265660.428722:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417634816 00000100:00100000:1.0:1789265660.428725:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417634816 00000100:00100000:1.0:1789265660.428734:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417635328 00000100:00100000:1.0:1789265660.428736:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417635328 00000100:00100000:1.0:1789265660.428746:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265660.428752:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1876180417634688:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789265660.428787:0:24265:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 711 last 0 00000020:00000080:1.0:1789265660.428817:0:24265:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a982f8 00002000:00100000:1.0:1789265660.428831:0:24265:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fcb849f5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789265660.428836:0:24265:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789265660.428838:0:24265:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789265660.428910:0:24265:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789265660.428932:0:24265:0:(import.c:65:import_set_state_nolock()) ffff9fcb849f5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265660.428973:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1876180417634688:12345-0@lo:8:kworker.0 Request processed in 220us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265660.428987:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265660.429002:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265660.429006:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1876180417634816:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789265660.429126:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417634944:0@lo:400:kworker.0 00000100:00100000:3.0:1789265660.429159:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265660.429182:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417635584:0@lo:400:kworker.0 00000100:00100000:3.0:1789265660.429213:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265660.429234:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789265660.429240:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417635072:0@lo:400:kworker.0 00000100:00100000:3.0:1789265660.429263:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265660.429280:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417635712:0@lo:400:kworker.0 00000100:00100000:3.0:1789265660.429363:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265660.429400:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417634432 00000100:00100000:3.0:1789265660.429405:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417634432 00000100:00100000:3.0:1789265660.429435:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789265660.429442:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+22:3641:x1876180417634432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265660.429479:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+22:3641:x1876180417634432:12345-0@lo:400:kworker.0 Request processed in 38us (3270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265660.429486:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789265660.429512:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417634944 00000100:00100000:3.0:1789265660.429515:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417634944 00000100:00100000:3.0:1789265660.429530:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417635584 00000100:00100000:3.0:1789265660.429532:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417635584 00000100:00100000:3.0:1789265660.429553:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417635712 00000100:00100000:3.0:1789265660.429556:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417635712 00000100:00100000:3.0:1789265660.429571:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789265660.429577:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417634944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265660.429609:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417634944:12345-0@lo:400:kworker.0 Request processed in 32us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265660.429616:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789265660.429626:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789265660.429633:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417635584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265660.429657:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417635584:12345-0@lo:400:kworker.0 Request processed in 25us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265660.429668:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789265660.429681:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789265660.429687:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417635712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265660.429713:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417635712:12345-0@lo:400:kworker.0 Request processed in 27us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265660.429719:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789265660.429737:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417635072 00000100:00100000:3.0:1789265660.429741:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417635072 00000100:00100000:3.0:1789265660.429772:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789265660.429779:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417635072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265660.429809:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417635072:12345-0@lo:400:kworker.0 Request processed in 31us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265660.429815:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789265660.429848:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417634432:0@lo:400:kworker.0 00000100:00080000:3.0:1789265660.429867:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265660.429870:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265660.429884:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417635072:0@lo:400:kworker.0 00010000:00080000:3.0:1789265660.429894:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e0380 x1876180417635712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265660.429904:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417635712:0@lo:400:kworker.0 00010000:00080000:3.0:1789265660.429913:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83da8000 x1876180417634944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265660.429921:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417634944:0@lo:400:kworker.0 00010000:00080000:3.0:1789265660.429929:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e0e00 x1876180417635584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265660.429944:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417635584:0@lo:400:kworker.0 00010000:00080000:1.0:1789265660.430016:0:24265:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 711 last 0 00000020:00000080:1.0:1789265660.430407:0:24265:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9272d942b4a982ff 00002000:00100000:1.0:1789265660.430418:0:24265:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fcb849f0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789265660.430421:0:24265:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789265660.430423:0:24265:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789265660.430565:0:24265:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789265660.430584:0:24265:0:(import.c:65:import_set_state_nolock()) ffff9fcb849f1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265660.430618:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1876180417634816:12345-0@lo:8:kworker.0 Request processed in 1611us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265660.430625:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265660.430641:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789265660.430646:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1876180417635328:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789265660.430666:0:24265:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 711 last 0 00000020:00000080:1.0:1789265660.430681:0:24265:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9272d942b4a98306 00002000:00100000:1.0:1789265660.430687:0:24265:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9fcb849f7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789265660.430691:0:24265:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1789265660.430693:0:24265:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789265660.430716:0:24265:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789265660.430728:0:24265:0:(import.c:65:import_set_state_nolock()) ffff9fcb849f4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789265660.430770:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1876180417635328:12345-0@lo:8:kworker.0 Request processed in 110us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265660.430777:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789265660.430837:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83daa300 x1876180417634688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265660.430846:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265660.430853:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789265660.430860:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789265660.430865:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789265660.430867:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcc82d4e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789265660.430930:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789265660.430935:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417634688:0@lo:8:kworker.0 00010000:00080000:1.0:1789265660.430949:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83da8a80 x1876180417634816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265660.430956:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789265660.430959:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789265660.430963:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789265660.430966:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789265660.430968:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fccb4fdb800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789265660.430979:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789265660.430982:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876180417634816:0@lo:8:kworker.0 00010000:00080000:1.0:1789265660.430994:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e2680 x1876180417635328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789265685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789265660.431003:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789265660.431007:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789265660.431010:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789265660.431011:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9fcca789a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789265660.431127:0:22783:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789265660.431190:0:22783:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 711661166251ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789265660.431196:0:22783:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789265660.432170:0:22784:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789265660.432192:0:22784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22784:1876180417636224:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789265660.432239:0:22784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265660.432264:0:22784:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc991376c0 going to sleep for 11 seconds 00000004:00080000:3.0:1789265660.432279:0:22785:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789265660.433148:0:22785:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 711663123670ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789265660.433155:0:22785:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789265660.433211:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789265660.433219:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876180417635328:0@lo:8:kworker.0 00000004:00080000:1.0:1789265660.433275:0:22786:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1789265660.433294:0:22786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22786:1876180417636480:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789265660.433399:0:22786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265660.433419:0:22786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc88495900 going to sleep for 11 seconds 00000100:00100000:1.0:1789265660.433435:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417636224 00000100:00100000:1.0:1789265660.433441:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417636224 00000100:00100000:1.0:1789265660.433483:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417636480 00000100:00100000:1.0:1789265660.433486:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417636480 00000100:00100000:1.0:1789265660.433507:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265660.433515:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22784:x1876180417636224:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789265660.437466:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265660.437484:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22786:x1876180417636480:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1789265660.437666:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789265660.437671:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1789265660.440242:0:24265:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1789265660.440256:0:24265:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:1.0:1789265660.440263:0:24265:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00000004:00080000:3.0:1789265660.441425:0:23503:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789265660.441464:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23503:1876180417636736:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789265660.441534:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265660.441566:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99137f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789265660.442119:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417636096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265660.442154:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265660.442185:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265660.442192:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb84845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417636352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265660.442218:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789265660.442250:0:23502:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789265660.442340:0:23502:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 711672316563ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789265660.442347:0:23502:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789265660.442374:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417636608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265660.442399:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265660.442436:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417636096 00000100:00100000:3.0:1789265660.442443:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417636096 00000100:00100000:3.0:1789265660.442477:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417636352 00000100:00100000:3.0:1789265660.442487:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417636352 00000100:00100000:3.0:1789265660.442503:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417636608 00000100:00100000:3.0:1789265660.442506:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417636608 00000100:00100000:3.0:1789265660.442534:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265660.442542:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876180417636096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265660.442568:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789265660.442626:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876180417636096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265660.442633:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789265660.442650:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265660.442656:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876180417636352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265660.442666:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915874304 avail 3684352000 00000100:00100000:3.0:1789265660.442693:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876180417636352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265660.442699:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789265660.442710:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789265660.442715:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1876180417636608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265660.442723:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915874304 avail 3684352000 00000100:00100000:3.0:1789265660.442746:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1876180417636608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265660.442752:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789265660.445298:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb84845f80 x1876180417636352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265660.446138:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb84845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417636352:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789265660.446160:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e0e00 x1876180417636096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265660.446185:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417636096:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789265660.446240:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e3480 x1876180417636608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789265676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265660.446252:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417636608:0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1789265660.449403:0:23492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1789265660.449468:0:22739:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789265660.449486:0:22739:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789265660.450140:0:24264:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789265660.450151:0:24264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00080000:2.0:1789265660.450170:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265660.450638:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417636736 00000100:00100000:2.0:1789265660.450647:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417636736 00000100:00100000:3.0:1789265660.450869:0:25154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265660.450880:0:25154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23503:x1876180417636736:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:2.0:1789265660.455141:0:24266:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789265660.455151:0:24266:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1789265660.455157:0:24266:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00010000:1.0:1789265660.465856:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.465869:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a43304be/0x9272d942b4a9830d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.465887:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.465892:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.465898:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a43304be/0x9272d942b4a9830d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.465914:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a43304be/0x9272d942b4a9830d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.465932:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a43304be/0x9272d942b4a9830d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.465940:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a43304be/0x9272d942b4a9830d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.469822:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789265660.470056:0:25154:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789265660.470062:0:25154:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789265660.470150:0:25154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23503:x1876180417636736:12345-0@lo:7:osp-pre-1-1.0 Request processed in 19269us (28612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265660.470161:0:25154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789265660.470210:0:23503:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcc837e1f80 x1876180417636736/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789265676 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265660.470225:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23503:1876180417636736:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789265660.470239:0:23503:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789265660.470278:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23503:1876180417636864:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789265660.470313:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265660.470337:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99449b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265660.470353:0:25154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417636864 00000100:00100000:1.0:1789265660.470359:0:25154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417636864 00000100:00100000:1.0:1789265660.470394:0:25154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789265660.470403:0:25154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23503:x1876180417636864:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789265660.470425:0:25154:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1789265660.470462:0:25154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23503:x1876180417636864:12345-0@lo:5:osp-pre-1-1.0 Request processed in 61us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265660.470470:0:25154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789265660.470495:0:23503:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83c99880 x1876180417636864/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789265676 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265660.470505:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23503:1876180417636864:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789265660.470514:0:23503:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789265660.470536:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23503:1876180417636992:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789265660.470557:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265660.470566:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc99449b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265660.470577:0:25154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417636992 00000100:00100000:1.0:1789265660.470581:0:25154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417636992 00000100:00100000:1.0:1789265660.470596:0:25154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789265660.470607:0:25154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23503:x1876180417636992:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789265660.470629:0:25154:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00010000:00010000:1.0:1789265660.474231:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.474245:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a43304be/0x9272d942b4a9830d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.474258:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fe800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.474264:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a43304be/0x9272d942b4a9830d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.474274:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a43304be/0x9272d942b4a9830d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.474309:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a43304be/0x9272d942b4a9830d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.474316:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a43304be/0x9272d942b4a9830d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.474338:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.474340:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.474342:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265660.474813:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.474821:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b106c9b8/0x9272d942b4a98314 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.474832:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.474835:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.474841:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b106c9b8/0x9272d942b4a98314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.474852:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b106c9b8/0x9272d942b4a98314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.474860:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b106c9b8/0x9272d942b4a98314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.474866:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b106c9b8/0x9272d942b4a98314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.474897:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.474908:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.474912:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b106c9b8/0x9272d942b4a98314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.474918:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2fec00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.474921:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b106c9b8/0x9272d942b4a98314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.474930:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b106c9b8/0x9272d942b4a98314 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.474941:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b106c9b8/0x9272d942b4a98314 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.474948:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b106c9b8/0x9272d942b4a98314 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.474974:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.474976:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.474978:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265660.475547:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.475553:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a9831b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.475563:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.475571:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.475576:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a9831b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.475585:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a9831b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.475592:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a9831b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.475598:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a9831b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.475611:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.475618:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.475622:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a9831b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.475629:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffc00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.475632:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a9831b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.475639:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a9831b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.475650:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a9831b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.475666:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc537cfd/0x9272d942b4a9831b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.475680:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.475681:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.475683:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265660.476104:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.476110:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053f9fb6b/0x9272d942b4a98322 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476119:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.476122:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.476126:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053f9fb6b/0x9272d942b4a98322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476135:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053f9fb6b/0x9272d942b4a98322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476143:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053f9fb6b/0x9272d942b4a98322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476151:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053f9fb6b/0x9272d942b4a98322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476164:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.476171:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.476181:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053f9fb6b/0x9272d942b4a98322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476188:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ffe00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.476191:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053f9fb6b/0x9272d942b4a98322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476200:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053f9fb6b/0x9272d942b4a98322 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476211:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053f9fb6b/0x9272d942b4a98322 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476218:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053f9fb6b/0x9272d942b4a98322 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476231:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.476233:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.476235:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265660.476552:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.476559:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7bb489/0x9272d942b4a98329 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476568:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.476571:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.476575:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f7bb489/0x9272d942b4a98329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476595:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f7bb489/0x9272d942b4a98329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476603:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7bb489/0x9272d942b4a98329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476611:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f7bb489/0x9272d942b4a98329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476625:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.476633:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.476636:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f7bb489/0x9272d942b4a98329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476643:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c6200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.476647:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7bb489/0x9272d942b4a98329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476655:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7bb489/0x9272d942b4a98329 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476666:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f7bb489/0x9272d942b4a98329 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476673:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f7bb489/0x9272d942b4a98329 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.476692:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.476694:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.476696:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265660.477168:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.477174:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000551f5c4d/0x9272d942b4a98330 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.477183:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.477186:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.477190:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000551f5c4d/0x9272d942b4a98330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.477200:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000551f5c4d/0x9272d942b4a98330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.477207:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000551f5c4d/0x9272d942b4a98330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.477214:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000551f5c4d/0x9272d942b4a98330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.477229:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.477237:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.477241:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000551f5c4d/0x9272d942b4a98330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.477260:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c6400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.477263:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000551f5c4d/0x9272d942b4a98330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.477271:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000551f5c4d/0x9272d942b4a98330 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.477282:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000551f5c4d/0x9272d942b4a98330 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.477290:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000551f5c4d/0x9272d942b4a98330 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.478111:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.478115:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.478117:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265660.481211:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.481225:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000101437a9/0x9272d942b4a98337 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.481242:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.481247:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.481253:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000101437a9/0x9272d942b4a98337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.481267:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000101437a9/0x9272d942b4a98337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.481287:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000101437a9/0x9272d942b4a98337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.481294:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000101437a9/0x9272d942b4a98337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.481892:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.481909:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.481915:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000101437a9/0x9272d942b4a98337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.481924:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c7000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.481929:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000101437a9/0x9272d942b4a98337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.481939:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000101437a9/0x9272d942b4a98337 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.481956:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000101437a9/0x9272d942b4a98337 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.485925:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000101437a9/0x9272d942b4a98337 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.485957:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.485973:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.485976:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265660.490883:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265660.490895:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a9833e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.490913:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789265660.490918:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265660.490924:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a9833e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789265660.491231:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.491238:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3bfed5/0x9272d942b4a98345 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.491247:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.491250:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.491254:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3bfed5/0x9272d942b4a98345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.491263:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe3bfed5/0x9272d942b4a98345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.491273:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3bfed5/0x9272d942b4a98345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.491279:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3bfed5/0x9272d942b4a98345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.491296:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.491317:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.491322:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe3bfed5/0x9272d942b4a98345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.491330:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c6000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.491334:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3bfed5/0x9272d942b4a98345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.491355:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3bfed5/0x9272d942b4a98345 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.491372:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe3bfed5/0x9272d942b4a98345 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.491380:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe3bfed5/0x9272d942b4a98345 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.491398:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.491400:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.491402:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265660.491903:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.491910:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f40b4c1/0x9272d942b4a9834c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.491920:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.491923:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.491928:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f40b4c1/0x9272d942b4a9834c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.491937:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f40b4c1/0x9272d942b4a9834c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.491946:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f40b4c1/0x9272d942b4a9834c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.491972:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f40b4c1/0x9272d942b4a9834c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.491994:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.492003:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.492008:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f40b4c1/0x9272d942b4a9834c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.492015:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c6e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.492040:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f40b4c1/0x9272d942b4a9834c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.492047:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f40b4c1/0x9272d942b4a9834c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.492059:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f40b4c1/0x9272d942b4a9834c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.492065:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f40b4c1/0x9272d942b4a9834c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.492078:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.492079:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.492081:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265660.492544:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.492556:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a98353 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.492565:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.492568:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.492572:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a98353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.492580:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a98353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.492587:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a98353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.492592:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a98353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.492603:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.492610:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.492613:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a98353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.492619:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c6600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.492622:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a98353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.492629:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a98353 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.492644:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a98353 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.492651:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a98353 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.492664:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.492665:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.492667:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265660.496797:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.496809:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a9835a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.496826:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.496830:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.496836:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a9835a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.496849:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a9835a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.496859:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a9835a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.496866:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a9835a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.496893:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.496905:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.496910:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a9835a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.496919:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c7800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.496923:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a9835a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.496933:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a9835a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.496950:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a9835a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.497004:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a9835a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.497208:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.497211:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.497213:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.497515:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a9833e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.497528:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a9833e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.497536:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a9833e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.497605:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.498159:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.498165:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a9833e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.498173:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.498181:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a9833e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.498190:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a9833e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.498206:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a9833e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.498213:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a9833e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.498233:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.498235:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.498237:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265660.500502:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.500514:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052284a07/0x9272d942b4a98361 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.500529:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.500533:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.500538:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052284a07/0x9272d942b4a98361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.500550:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052284a07/0x9272d942b4a98361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.500558:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052284a07/0x9272d942b4a98361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.500571:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052284a07/0x9272d942b4a98361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.500601:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.500768:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.500775:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052284a07/0x9272d942b4a98361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.500783:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c7600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.500787:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052284a07/0x9272d942b4a98361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.500795:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052284a07/0x9272d942b4a98361 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.500811:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052284a07/0x9272d942b4a98361 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.500817:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052284a07/0x9272d942b4a98361 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.500833:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.500835:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.500836:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.501247:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.501254:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a98368 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.501264:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.501267:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.501272:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a98368 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.501282:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a98368 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.501291:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a98368 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.501298:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a98368 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.501322:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.501493:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.501503:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a98368 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.501510:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.501513:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a98368 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.501520:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a98368 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.501532:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a98368 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.501539:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c082110/0x9272d942b4a98368 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.501555:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.501557:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.501558:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.502105:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.502112:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096eac9fc/0x9272d942b4a9836f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.502121:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.502124:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.502135:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096eac9fc/0x9272d942b4a9836f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.502147:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096eac9fc/0x9272d942b4a9836f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.502155:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096eac9fc/0x9272d942b4a9836f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.502162:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096eac9fc/0x9272d942b4a9836f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.502173:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.502533:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.502539:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096eac9fc/0x9272d942b4a9836f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.502548:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.502552:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096eac9fc/0x9272d942b4a9836f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.502574:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096eac9fc/0x9272d942b4a9836f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.502600:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096eac9fc/0x9272d942b4a9836f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.502608:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096eac9fc/0x9272d942b4a9836f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.502624:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.502626:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.502628:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265660.502671:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.502676:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003661859d/0x9272d942b4a98376 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.502685:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.502688:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.502692:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003661859d/0x9272d942b4a98376 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.502702:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003661859d/0x9272d942b4a98376 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.502710:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003661859d/0x9272d942b4a98376 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.502723:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003661859d/0x9272d942b4a98376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.502738:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.502745:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.502749:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003661859d/0x9272d942b4a98376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.502755:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c6a00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.502771:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003661859d/0x9272d942b4a98376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.502779:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003661859d/0x9272d942b4a98376 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.502791:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003661859d/0x9272d942b4a98376 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.502799:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003661859d/0x9272d942b4a98376 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.502814:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.502815:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.502817:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265660.503436:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.503451:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb8bff/0x9272d942b4a9837d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.503459:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.503463:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.503467:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb8bff/0x9272d942b4a9837d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.503477:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb8bff/0x9272d942b4a9837d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.503485:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb8bff/0x9272d942b4a9837d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.503491:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb8bff/0x9272d942b4a9837d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.503506:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.503514:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.503518:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb8bff/0x9272d942b4a9837d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.503525:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c6c00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.503528:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb8bff/0x9272d942b4a9837d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.503536:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb8bff/0x9272d942b4a9837d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.503555:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb8bff/0x9272d942b4a9837d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.503562:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb8bff/0x9272d942b4a9837d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.503577:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.505796:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.505804:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265660.506780:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.506790:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002deca028/0x9272d942b4a98384 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.506806:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.506810:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.506816:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002deca028/0x9272d942b4a98384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.506829:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002deca028/0x9272d942b4a98384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.506839:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002deca028/0x9272d942b4a98384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.506846:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002deca028/0x9272d942b4a98384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.506875:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.506884:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.506890:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002deca028/0x9272d942b4a98384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.506897:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c6800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.506902:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002deca028/0x9272d942b4a98384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.506912:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002deca028/0x9272d942b4a98384 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.506928:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002deca028/0x9272d942b4a98384 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.506935:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002deca028/0x9272d942b4a98384 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.506961:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.506963:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.506965:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.507472:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.507479:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a9838b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.507488:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.507491:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.507496:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a9838b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.507506:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a9838b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.507514:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a9838b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.507533:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a9838b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.507546:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789265660.507819:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.507824:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddd2633f/0x9272d942b4a98392 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.507833:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.507836:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.507840:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddd2633f/0x9272d942b4a98392 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.507848:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddd2633f/0x9272d942b4a98392 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.507855:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddd2633f/0x9272d942b4a98392 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.507861:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddd2633f/0x9272d942b4a98392 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.507873:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789265660.508240:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.508247:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2022800/0x9272d942b4a98399 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.508261:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.508265:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.508269:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2022800/0x9272d942b4a98399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.508278:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2022800/0x9272d942b4a98399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.508286:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2022800/0x9272d942b4a98399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.508293:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2022800/0x9272d942b4a98399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.508313:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789265660.508581:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.508587:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004ba89c4/0x9272d942b4a983a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.508595:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.508599:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.508603:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004ba89c4/0x9272d942b4a983a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.508613:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004ba89c4/0x9272d942b4a983a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.508631:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004ba89c4/0x9272d942b4a983a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.508638:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004ba89c4/0x9272d942b4a983a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.508647:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1789265660.508924:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789265660.508932:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a9838b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.508940:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.508950:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a9838b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.508968:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a9838b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.508984:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a9838b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.508991:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fb0b17f/0x9272d942b4a9838b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.509007:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789265660.509011:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddd2633f/0x9272d942b4a98392 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.509043:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.509047:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddd2633f/0x9272d942b4a98392 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.509054:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddd2633f/0x9272d942b4a98392 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.509063:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddd2633f/0x9272d942b4a98392 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.509070:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddd2633f/0x9272d942b4a98392 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.509091:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265660.509094:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2022800/0x9272d942b4a98399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.509100:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4a00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.509103:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2022800/0x9272d942b4a98399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.509111:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2022800/0x9272d942b4a98399 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.509120:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2022800/0x9272d942b4a98399 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.509127:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2022800/0x9272d942b4a98399 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.509139:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.509143:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004ba89c4/0x9272d942b4a983a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.509149:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5c00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.509152:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004ba89c4/0x9272d942b4a983a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.509173:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004ba89c4/0x9272d942b4a983a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.509184:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004ba89c4/0x9272d942b4a983a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.509191:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004ba89c4/0x9272d942b4a983a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.509204:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.509206:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.509207:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.509213:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.511612:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.511623:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a983a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.511637:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.511641:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.511646:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a983a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.511659:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a983a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.511666:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a983a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.511674:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a983a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.511709:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789265660.511871:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.511877:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a983ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.511886:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.511889:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.511893:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a983ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.511902:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a983ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.511910:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a983ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.511917:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a983ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.511929:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789265660.512042:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265660.512050:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a983a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.512058:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265660.512062:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a983a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.512070:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a983a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.512089:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a983a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.512096:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4f5d45e/0x9272d942b4a983a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.512125:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265660.512129:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a983ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.512134:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da4800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265660.512138:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a983ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.512145:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a983ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.512155:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a983ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.512162:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d871ee3c/0x9272d942b4a983ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.512172:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265660.512174:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265660.512175:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.513204:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.513213:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e27a5ed/0x9272d942b4a983b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.513225:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.513234:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.513240:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e27a5ed/0x9272d942b4a983b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.513252:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e27a5ed/0x9272d942b4a983b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.513259:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e27a5ed/0x9272d942b4a983b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.513267:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e27a5ed/0x9272d942b4a983b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.513283:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.515226:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.515237:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e27a5ed/0x9272d942b4a983b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.515249:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5a00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.515254:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e27a5ed/0x9272d942b4a983b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.515263:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e27a5ed/0x9272d942b4a983b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.515282:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e27a5ed/0x9272d942b4a983b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.515296:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e27a5ed/0x9272d942b4a983b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.515315:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.515317:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.515318:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265660.515482:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265660.517292:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.517315:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4dd1272/0x9272d942b4a983bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.517329:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.517333:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.517339:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4dd1272/0x9272d942b4a983bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.517351:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4dd1272/0x9272d942b4a983bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.517360:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4dd1272/0x9272d942b4a983bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.517367:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4dd1272/0x9272d942b4a983bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.517384:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.517395:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.517407:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4dd1272/0x9272d942b4a983bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.517414:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c7c00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.517418:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4dd1272/0x9272d942b4a983bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.517426:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4dd1272/0x9272d942b4a983bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.517441:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4dd1272/0x9272d942b4a983bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.517448:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4dd1272/0x9272d942b4a983bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.517464:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.517466:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.517467:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.524363:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.524377:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a983c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.524394:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.524399:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.524405:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a983c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.524419:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a983c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.524429:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a983c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.524449:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a983c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.524477:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.524698:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.524706:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a983c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.524714:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.524719:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a983c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.524738:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a983c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.524754:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a983c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.524771:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba8b6fa1/0x9272d942b4a983c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.524791:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.524793:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.524795:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.525295:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.525313:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ab14eb8/0x9272d942b4a983ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.525324:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.525327:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.525332:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ab14eb8/0x9272d942b4a983ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.525342:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ab14eb8/0x9272d942b4a983ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.525351:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ab14eb8/0x9272d942b4a983ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.525359:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ab14eb8/0x9272d942b4a983ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.525378:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789265660.525505:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.525511:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ab14eb8/0x9272d942b4a983ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.525518:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc80031e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.525521:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ab14eb8/0x9272d942b4a983ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.525528:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ab14eb8/0x9272d942b4a983ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.525540:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ab14eb8/0x9272d942b4a983ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.525559:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ab14eb8/0x9272d942b4a983ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.525575:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.525577:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.525578:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265660.528349:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.528362:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd2e482e/0x9272d942b4a983d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.528378:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.528382:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.528388:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd2e482e/0x9272d942b4a983d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.528401:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd2e482e/0x9272d942b4a983d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.528411:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd2e482e/0x9272d942b4a983d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.528417:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd2e482e/0x9272d942b4a983d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.528443:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265660.528934:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265660.528943:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd2e482e/0x9272d942b4a983d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.528969:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c7200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265660.528974:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd2e482e/0x9272d942b4a983d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.528982:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd2e482e/0x9272d942b4a983d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.529000:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd2e482e/0x9272d942b4a983d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.529008:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd2e482e/0x9272d942b4a983d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.529169:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.529172:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.529174:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265660.529437:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.529449:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a983d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.529459:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.529463:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.529469:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a983d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.529479:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a983d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.529489:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a983d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.529496:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a983d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.529523:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265660.529897:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265660.529903:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a983d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.529910:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c7800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265660.529914:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a983d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.529921:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a983d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.529944:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a983d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.529960:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a983d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.529977:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.529979:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.529981:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789265660.530287:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789265660.530294:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a983df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.530314:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789265660.530318:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265660.530323:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a983df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.530333:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a983df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.530348:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a983df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.530355:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a983df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.530375:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265660.530604:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265660.530609:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a983df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.530618:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c6600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265660.530622:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a983df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.530629:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a983df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.530642:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a983df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.530648:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000490326e1/0x9272d942b4a983df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.530674:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.530676:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.530678:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265660.539561:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265660.539575:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a983e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.539592:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789265660.539597:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265660.539603:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a983e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.539618:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a983e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.539627:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a983e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.539646:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a983e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.539668:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265660.542333:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265660.542347:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a983ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.542365:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789265660.542369:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265660.542375:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a983ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.542390:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a983ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.542400:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a983ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.542407:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a983ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.542426:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789265660.542735:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265660.542743:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a983e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.542752:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265660.542756:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a983e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.542777:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a983e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.542793:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a983e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.542800:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccb0e6c9/0x9272d942b4a983e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.542814:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265660.542818:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a983ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.542823:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265660.542831:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a983ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.542838:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a983ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.542848:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a983ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.542854:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a983ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.542866:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.542868:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.542870:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.542876:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265660.544221:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265660.544233:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef3c678c/0x9272d942b4a983f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.544247:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789265660.544258:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265660.544264:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef3c678c/0x9272d942b4a983f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.544276:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef3c678c/0x9272d942b4a983f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.544285:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef3c678c/0x9272d942b4a983f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.544292:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef3c678c/0x9272d942b4a983f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.544324:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789265660.544730:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265660.544737:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a983fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.544753:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789265660.544756:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265660.544772:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a983fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.544782:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a983fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.544790:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a983fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.544798:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a983fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.544816:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789265660.544825:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265660.544830:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef3c678c/0x9272d942b4a983f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.544839:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265660.544843:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef3c678c/0x9272d942b4a983f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.544852:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef3c678c/0x9272d942b4a983f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.544878:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef3c678c/0x9272d942b4a983f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.544886:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef3c678c/0x9272d942b4a983f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.544902:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265660.544906:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a983fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.544913:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265660.544916:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a983fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.544924:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a983fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.544934:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a983fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.544940:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a983fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.544964:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.544966:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.544973:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265660.546811:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265660.546823:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133aa4e2/0x9272d942b4a98402 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.546839:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789265660.546843:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265660.546848:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133aa4e2/0x9272d942b4a98402 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.546861:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133aa4e2/0x9272d942b4a98402 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.546870:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133aa4e2/0x9272d942b4a98402 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.546878:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133aa4e2/0x9272d942b4a98402 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.546895:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265660.546905:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265660.546911:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133aa4e2/0x9272d942b4a98402 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.546918:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265660.546923:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133aa4e2/0x9272d942b4a98402 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.546943:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133aa4e2/0x9272d942b4a98402 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.547056:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133aa4e2/0x9272d942b4a98402 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.547066:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133aa4e2/0x9272d942b4a98402 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.547083:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.547085:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.547087:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265660.547420:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265660.547426:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7821926/0x9272d942b4a98409 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.547435:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789265660.547438:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265660.547442:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7821926/0x9272d942b4a98409 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.547452:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7821926/0x9272d942b4a98409 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.547460:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7821926/0x9272d942b4a98409 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.547475:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7821926/0x9272d942b4a98409 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.547493:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265660.548102:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265660.548109:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7821926/0x9272d942b4a98409 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.548116:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f53200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265660.548120:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7821926/0x9272d942b4a98409 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.548127:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7821926/0x9272d942b4a98409 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.548140:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7821926/0x9272d942b4a98409 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.548158:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7821926/0x9272d942b4a98409 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.548175:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.548176:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.548178:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265660.548219:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265660.548224:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca752cbf/0x9272d942b4a98410 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.548232:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789265660.548236:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265660.548240:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca752cbf/0x9272d942b4a98410 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.548249:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca752cbf/0x9272d942b4a98410 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.548257:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca752cbf/0x9272d942b4a98410 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.548265:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca752cbf/0x9272d942b4a98410 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.548277:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265660.548284:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265660.548292:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca752cbf/0x9272d942b4a98410 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.548299:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2ea00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265660.548314:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca752cbf/0x9272d942b4a98410 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.548322:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca752cbf/0x9272d942b4a98410 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.548333:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca752cbf/0x9272d942b4a98410 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.548340:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca752cbf/0x9272d942b4a98410 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.548355:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.548357:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.548358:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.549924:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265660.551190:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265660.551200:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053508460/0x9272d942b4a98417 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.551216:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789265660.551220:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265660.551225:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053508460/0x9272d942b4a98417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.551249:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053508460/0x9272d942b4a98417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.551258:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053508460/0x9272d942b4a98417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.551265:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053508460/0x9272d942b4a98417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.551281:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265660.551292:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265660.551296:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053508460/0x9272d942b4a98417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.551310:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265660.551314:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053508460/0x9272d942b4a98417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.551322:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053508460/0x9272d942b4a98417 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.551337:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053508460/0x9272d942b4a98417 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.551344:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053508460/0x9272d942b4a98417 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.551367:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.551369:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.551370:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265660.551579:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265660.551586:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000380cdb12/0x9272d942b4a9841e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.551594:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789265660.551598:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265660.551602:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000380cdb12/0x9272d942b4a9841e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.551612:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000380cdb12/0x9272d942b4a9841e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.551620:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000380cdb12/0x9272d942b4a9841e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.551626:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000380cdb12/0x9272d942b4a9841e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.551647:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789265660.553259:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265660.553269:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8cacec/0x9272d942b4a98425 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.553289:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789265660.553293:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265660.553298:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a8cacec/0x9272d942b4a98425 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.553317:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a8cacec/0x9272d942b4a98425 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.553326:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8cacec/0x9272d942b4a98425 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.553333:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a8cacec/0x9272d942b4a98425 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.553349:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789265660.553549:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789265660.553556:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000380cdb12/0x9272d942b4a9841e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.553564:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52a00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265660.553568:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000380cdb12/0x9272d942b4a9841e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.553577:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000380cdb12/0x9272d942b4a9841e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.553594:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000380cdb12/0x9272d942b4a9841e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.553601:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000380cdb12/0x9272d942b4a9841e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.553618:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265660.553622:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a8cacec/0x9272d942b4a98425 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.553628:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f53000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265660.553638:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8cacec/0x9272d942b4a98425 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.553646:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8cacec/0x9272d942b4a98425 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.553657:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a8cacec/0x9272d942b4a98425 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.553664:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a8cacec/0x9272d942b4a98425 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.553678:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.553680:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.553682:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.553689:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265660.557077:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265660.557091:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f07ba58/0x9272d942b4a9842c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.557108:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789265660.557113:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265660.557119:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f07ba58/0x9272d942b4a9842c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.557134:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f07ba58/0x9272d942b4a9842c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.557156:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f07ba58/0x9272d942b4a9842c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.557164:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f07ba58/0x9272d942b4a9842c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.557180:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265660.557795:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265660.557803:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f07ba58/0x9272d942b4a9842c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.557811:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52c00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265660.557815:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f07ba58/0x9272d942b4a9842c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.557824:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f07ba58/0x9272d942b4a9842c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.557841:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f07ba58/0x9272d942b4a9842c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.557855:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f07ba58/0x9272d942b4a9842c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.557875:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.557876:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.557878:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789265660.560069:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265660.560082:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baf16215/0x9272d942b4a98433 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.560097:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789265660.560101:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265660.560107:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baf16215/0x9272d942b4a98433 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.560120:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baf16215/0x9272d942b4a98433 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.560128:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baf16215/0x9272d942b4a98433 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.560136:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000baf16215/0x9272d942b4a98433 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.560161:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265660.560513:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265660.560521:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000baf16215/0x9272d942b4a98433 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.560530:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f52400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265660.560535:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000baf16215/0x9272d942b4a98433 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.560544:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000baf16215/0x9272d942b4a98433 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.560560:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000baf16215/0x9272d942b4a98433 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.560568:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000baf16215/0x9272d942b4a98433 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.560586:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.560588:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.560589:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265660.560643:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265660.560649:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b76d190/0x9272d942b4a9843a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.560658:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789265660.560661:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265660.560666:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b76d190/0x9272d942b4a9843a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.560675:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b76d190/0x9272d942b4a9843a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.560682:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b76d190/0x9272d942b4a9843a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.560689:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b76d190/0x9272d942b4a9843a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.560704:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265660.560711:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265660.560715:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b76d190/0x9272d942b4a9843a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.560721:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265660.560724:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b76d190/0x9272d942b4a9843a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.560741:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b76d190/0x9272d942b4a9843a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.560751:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b76d190/0x9272d942b4a9843a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.560771:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b76d190/0x9272d942b4a9843a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.560789:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.560791:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.560793:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265660.561463:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265660.561471:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a98441 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.561481:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789265660.561485:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265660.561489:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a98441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.561498:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a98441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.561506:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a98441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.561519:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a98441 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.561533:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265660.561543:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265660.561547:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a98441 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.561554:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265660.561558:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a98441 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.561566:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a98441 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.561578:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a98441 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.561585:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001664e76/0x9272d942b4a98441 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.561597:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.561599:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.561600:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789265660.565038:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789265660.565067:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c603346b/0x9272d942b4a98448 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.565084:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789265660.565089:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265660.565096:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c603346b/0x9272d942b4a98448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.565112:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c603346b/0x9272d942b4a98448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.565121:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c603346b/0x9272d942b4a98448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.565128:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c603346b/0x9272d942b4a98448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.565152:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789265660.565171:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265660.565176:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c603346b/0x9272d942b4a98448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.565184:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265660.565188:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c603346b/0x9272d942b4a98448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.565197:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c603346b/0x9272d942b4a98448 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.565221:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c603346b/0x9272d942b4a98448 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.565228:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c603346b/0x9272d942b4a98448 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.565247:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.565249:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.565251:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.574882:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.574895:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b359bfa/0x9272d942b4a9844f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.574912:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.574916:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.574922:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b359bfa/0x9272d942b4a9844f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.574935:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b359bfa/0x9272d942b4a9844f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.576051:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b359bfa/0x9272d942b4a9844f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.576065:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b359bfa/0x9272d942b4a9844f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.576087:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789265660.576366:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789265660.576373:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000613bb617/0x9272d942b4a98456 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.576385:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789265660.576389:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265660.576394:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000613bb617/0x9272d942b4a98456 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.576405:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000613bb617/0x9272d942b4a98456 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.576412:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000613bb617/0x9272d942b4a98456 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.576419:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000613bb617/0x9272d942b4a98456 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.576432:0:24265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1789265660.576712:0:24265:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1789265660.576811:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22784:x1876180417636224:12345-0@lo:5:osp-pre-0-0.0 Request processed in 143293us (144567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265660.576821:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265660.576876:0:22784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22784:1876180417636224:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789265660.576898:0:22784:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789265660.576940:0:22784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22784:1876180417637120:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789265660.576987:0:22784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265660.577010:0:22784:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc991376c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265660.577053:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417637120 00000100:00100000:3.0:1789265660.577059:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417637120 00000100:00100000:3.0:1789265660.577095:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789265660.577103:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22784:x1876180417637120:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789265660.577134:0:24264:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:0.0:1789265660.585163:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265660.585179:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b359bfa/0x9272d942b4a9844f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585194:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc80031a00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265660.585198:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b359bfa/0x9272d942b4a9844f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585209:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b359bfa/0x9272d942b4a9844f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585231:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b359bfa/0x9272d942b4a9844f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585240:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b359bfa/0x9272d942b4a9844f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585266:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265660.585286:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000613bb617/0x9272d942b4a98456 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585294:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83f53a00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265660.585298:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000613bb617/0x9272d942b4a98456 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585305:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000613bb617/0x9272d942b4a98456 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585318:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000613bb617/0x9272d942b4a98456 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585326:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000613bb617/0x9272d942b4a98456 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585344:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.585348:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.585350:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.585653:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.585661:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4a5bfc1/0x9272d942b4a9845d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585674:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.585679:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.585685:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4a5bfc1/0x9272d942b4a9845d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585708:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4a5bfc1/0x9272d942b4a9845d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585718:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4a5bfc1/0x9272d942b4a9845d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585725:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4a5bfc1/0x9272d942b4a9845d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585742:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265660.585752:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265660.585755:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4a5bfc1/0x9272d942b4a9845d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585773:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc80031000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265660.585777:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4a5bfc1/0x9272d942b4a9845d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585785:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4a5bfc1/0x9272d942b4a9845d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585796:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4a5bfc1/0x9272d942b4a9845d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585803:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4a5bfc1/0x9272d942b4a9845d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.585823:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.585824:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.585826:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.586364:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.586371:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000708d6c80/0x9272d942b4a98464 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586380:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.586384:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.586388:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000708d6c80/0x9272d942b4a98464 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586398:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000708d6c80/0x9272d942b4a98464 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586406:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000708d6c80/0x9272d942b4a98464 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586414:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000708d6c80/0x9272d942b4a98464 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586428:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265660.586435:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265660.586439:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000708d6c80/0x9272d942b4a98464 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586458:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc80031400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265660.586461:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000708d6c80/0x9272d942b4a98464 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586470:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000708d6c80/0x9272d942b4a98464 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586482:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000708d6c80/0x9272d942b4a98464 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586489:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000708d6c80/0x9272d942b4a98464 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586504:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.586506:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.586507:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.586816:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.586822:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a9846b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586830:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.586833:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.586837:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a9846b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586846:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a9846b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586862:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a9846b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586869:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a9846b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586882:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265660.586889:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265660.586892:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a9846b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586899:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc80030400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265660.586902:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a9846b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586909:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a9846b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586920:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a9846b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586928:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a9846b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.586942:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.586950:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.586964:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.587385:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.587391:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a98472 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.587399:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.587402:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.587406:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a98472 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.587415:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a98472 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.587423:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a98472 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.587430:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a98472 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.587443:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265660.587451:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265660.587455:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a98472 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.587462:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc80030000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265660.587465:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a98472 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.587484:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a98472 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.587495:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a98472 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.587502:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a98472 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.587514:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.587516:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.587518:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.588076:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.588083:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a98479 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.588093:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.588096:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.588100:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a98479 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.588110:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a98479 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.588117:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a98479 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.588131:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a98479 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.588145:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789265660.588153:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265660.588156:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a98479 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.588163:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc80031e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265660.588166:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a98479 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.588174:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a98479 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.588186:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a98479 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.588193:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a98479 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.588207:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.588209:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265660.588210:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.588570:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.590947:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.591014:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a98480 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.591048:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.591053:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.591059:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a98480 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.591072:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a98480 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.591082:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a98480 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.591090:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a98480 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.591110:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789265660.593138:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.593150:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a98487 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.593166:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.593170:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.593176:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a98487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.593188:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a98487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.593206:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a98487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.593214:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a98487 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.593238:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789265660.593405:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789265660.593413:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a98480 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.593421:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2ea00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.593424:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a98480 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.593433:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a98480 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.593449:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a98480 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.593456:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a98480 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.593474:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.593483:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a98487 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.593489:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.593492:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a98487 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.593499:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a98487 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.593510:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a98487 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.593516:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a98487 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.593530:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.593532:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.593533:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.593825:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789265660.596615:0:24260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1789265660.596658:0:24260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789265660.597625:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22784:x1876180417637120:12345-0@lo:5:osp-pre-0-0.0 Request processed in 20517us (20632us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1789265660.597636:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00002000:00010000:0.0:1789265660.597739:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.597747:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a9848e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.597776:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.597781:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.597788:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a9848e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.597802:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a9848e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.597811:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a9848e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.597831:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a9848e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.597854:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789265660.598402:0:22784:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1789265660.598411:0:22784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22784:1876180417637120:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789265660.598427:0:22784:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000001:00080000:2.0:1789265660.598791:0:25080:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1789265660.598815:0:25080:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789265660.598820:0:25080:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789265660.598899:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265660.598907:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a9848e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.598916:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f200 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265660.598920:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a9848e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.598941:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a9848e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.599061:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a9848e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.599071:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008987ee09/0x9272d942b4a9848e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.599089:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.599091:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265660.599093:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.600173:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.600182:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a98495 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.600195:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.600198:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.600204:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a98495 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.600215:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a98495 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.600224:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a98495 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.600231:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a98495 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.600248:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789265660.600512:0:25154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:23503:x1876180417636992:12345-0@lo:5:osp-pre-1-1.0 Request processed in 129907us (129951us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789265660.600530:0:25154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1789265660.602697:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265660.602709:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a98495 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.602721:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:2.0:1789265660.602725:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a98495 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.602735:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a98495 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.602754:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a98495 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.602781:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000161eb519/0x9272d942b4a98495 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265660.602801:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.602803:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265660.602804:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.603705:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.603715:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a9849c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.603729:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.603733:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.603738:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a9849c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.603749:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a9849c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.603767:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a9849c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.603774:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a9849c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.603792:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265660.608141:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265660.608166:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a9849c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.608180:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265660.608185:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a9849c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.608195:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a9849c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.608238:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a9849c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.608246:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccb0e6c9/0x9272d942b4a9849c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.608269:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265660.608271:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265660.608273:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265660.612094:0:23503:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1789265660.612109:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23503:1876180417636992:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789265660.612126:0:23503:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1789265660.612178:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23503:1876180417637248:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789265660.612232:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265660.612267:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0f2f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265660.615003:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417637248 00000100:00100000:0.0:1789265660.615016:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417637248 00000100:00100000:0.0:1789265660.615185:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265660.615195:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23503:x1876180417637248:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789265660.615284:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23503:x1876180417637248:12345-0@lo:900:osp-pre-1-1.0 Request processed in 90us (3050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265660.615302:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:0.0:1789265660.615405:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.615414:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a984a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.615432:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.615438:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.615445:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a984a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.615458:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a984a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.615467:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a984a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.615474:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a984a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.615498:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789265660.616266:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.616274:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a984aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.616285:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.616289:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.616301:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a984aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.616313:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a984aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.616320:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a984aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.616327:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a984aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.616348:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789265660.616492:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789265660.616501:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a984a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.616509:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265660.616513:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a984a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.616520:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a984a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.616538:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a984a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.616545:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000133aa4e2/0x9272d942b4a984a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.616572:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265660.616577:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a984aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.616583:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2ea00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265660.616586:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a984aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.616594:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a984aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.616605:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a984aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.616612:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca752cbf/0x9272d942b4a984aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.616625:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265660.616627:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265660.616628:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.616993:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.617000:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a984b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.617009:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.617012:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.617016:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a984b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.617050:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a984b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.617059:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a984b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.617076:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a984b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.617091:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265660.617313:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265660.617319:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a984b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.617327:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc80031e00 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265660.617336:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a984b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.617344:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a984b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.617357:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a984b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.617365:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ab14eb8/0x9272d942b4a984b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.617380:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265660.617382:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265660.617384:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.617629:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.617636:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a984b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.617644:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.617647:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.617651:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a984b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.617661:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a984b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.617668:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a984b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.617674:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a984b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.617693:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789265660.617835:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265660.617842:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a984b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.617849:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc80030000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265660.617852:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a984b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.617859:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a984b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.617870:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a984b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.617883:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d898df1/0x9272d942b4a984b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.617899:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265660.617901:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265660.617903:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265660.618068:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789265660.618175:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789265660.618180:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a984bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.618194:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789265660.618197:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265660.618201:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a984bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.618210:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a984bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.618218:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a984bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.618226:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a984bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.618245:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789265660.618276:0:24266:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:0.0:1789265660.618367:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22786:x1876180417636480:12345-0@lo:5:osp-pre-1-0.0 Request processed in 180887us (184964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265660.618376:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789265660.618437:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789265660.618444:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a984bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.618451:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc80030400 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265660.618454:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a984bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.618461:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a984bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.618473:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a984bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.618480:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f12a0aa/0x9272d942b4a984bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.618493:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265660.618495:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265660.618501:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265660.619500:0:22786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22786:1876180417636480:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789265660.619515:0:22786:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1789265660.619557:0:22786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22786:1876180417637376:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789265660.619593:0:22786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265660.619620:0:22786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0f2f540 going to sleep for 11 seconds 00000100:00100000:3.0:1789265660.620769:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417637376 00000100:00100000:3.0:1789265660.620779:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417637376 00000100:00100000:3.0:1789265660.620829:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265660.620838:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22786:x1876180417637376:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789265660.620878:0:24265:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1789265660.626780:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22786:x1876180417637376:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5938us (7181us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789265660.626792:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789265660.626855:0:22786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22786:1876180417637376:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789265660.626869:0:22786:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00080000:1.0:1789265660.627294:0:23503:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83c99880 x1876180417637248/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789265676 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265660.627307:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23503:1876180417637248:0@lo:900:osp-pre-1-1.0 10000000:01000000:1.0:1789265660.740784:0:22757:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789265660.740793:0:22757:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fccb092a000 from 14 10000000:01000000:1.0:1789265660.740799:0:22757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789265660.740846:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb71c7c00/0x9272d942b4a984c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.740858:0:22757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fccb71c7c00/0x9272d942b4a984c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.740884:0:22757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fccb71c7c00/0x9272d942b4a984c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265660.740912:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417637504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789265660.740993:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265660.741055:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0f2f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265660.741350:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417637504 00000100:00100000:3.0:1789265660.741359:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417637504 00000100:00100000:3.0:1789265660.741535:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789265660.741545:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+22:22757:x1876180417637504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265660.741558:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265660.741573:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a984cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a984c6 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.741597:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a984cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a984c6 expref: 23 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.741608:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f52400/0x9272d942b4a984cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a984c6 expref: 23 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.741618:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f52400, rc 0) 00000100:00100000:3.0:1789265660.741657:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+23:22757:x1876180417637504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265660.741676:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789265660.741863:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417637504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265660.741889:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fccb71c7c00/0x9272d942b4a984c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a984cd expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.741899:0:22757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fccb71c7c00/0x9272d942b4a984c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a984cd expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265660.741948:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417637632:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789265660.744923:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265660.744982:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0f2f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265660.745070:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417637632 00000100:00100000:3.0:1789265660.745078:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417637632 00000100:00100000:3.0:1789265660.745125:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789265660.745135:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+23:22757:x1876180417637632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789265660.745156:0:22753:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789265660.745188:0:22753:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789265660.745192:0:22753:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1789265660.745288:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+23:22757:x1876180417637632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 154us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265660.745296:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789265660.745734:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417637632:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789265660.745818:0:22757:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789265660.745827:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fccb71c7c00/0x9272d942b4a984c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a984cd expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.745848:0:22757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fccb71c7c00/0x9272d942b4a984c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a984cd expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265660.745859:0:22757:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789265660.745861:0:22757:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fccbc1ce800 from 14 10000000:01000000:0.0:1789265660.745864:0:22757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789265660.745903:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc80031400/0x9272d942b4a984d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.745911:0:22757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc80031400/0x9272d942b4a984d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.745921:0:22757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc80031400/0x9272d942b4a984d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265660.745940:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417637760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265660.746167:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265660.746285:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd3426c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789265660.746395:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417637760 00000100:00100000:3.0:1789265660.746401:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417637760 00000100:00100000:3.0:1789265660.746435:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789265660.746441:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+23:22757:x1876180417637760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265660.746450:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265660.746462:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f52c00/0x9272d942b4a984db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a984d4 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.746483:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f52c00/0x9272d942b4a984db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a984d4 expref: 24 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.746493:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f52c00/0x9272d942b4a984db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a984d4 expref: 24 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265660.746502:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f52c00, rc 0) 00000100:00100000:3.0:1789265660.746541:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+24:22757:x1876180417637760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265660.746555:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789265660.746617:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417637760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265660.746636:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc80031400/0x9272d942b4a984d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a984db expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.746644:0:22757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc80031400/0x9272d942b4a984d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a984db expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265660.746683:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417637888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789265660.746712:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265660.746734:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccb0f2f600 going to sleep for 11 seconds 00000100:00100000:3.0:1789265660.747994:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417637888 00000100:00100000:3.0:1789265660.748004:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417637888 00000100:00100000:3.0:1789265660.748076:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789265660.748085:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+24:22757:x1876180417637888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789265660.748106:0:22754:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789265660.748125:0:22754:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789265660.748128:0:22754:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1789265660.748527:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+24:22757:x1876180417637888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 442us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265660.748536:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789265660.748989:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417637888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789265660.749102:0:22757:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789265660.749112:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc80031400/0x9272d942b4a984d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a984db expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265660.749122:0:22757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc80031400/0x9272d942b4a984d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a984db expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265660.802188:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265661.825284:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265662.849351:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265663.489608:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417638016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265663.489675:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265663.489728:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417638144:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265663.489766:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265663.489792:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265663.489800:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417638272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265663.489835:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265663.489875:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417638016 00000100:00100000:0.0:1789265663.490167:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417638272 00000100:00100000:0.0:1789265663.490174:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417638272 00000100:00100000:0.0:1789265663.490220:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789265663.490229:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417638272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789265663.490262:0:22765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789265663.490312:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417638272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265663.490320:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789265663.490378:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417638272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265663.491656:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417638016 00000100:00100000:2.0:1789265663.491709:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789265663.491720:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417638016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265663.491761:0:23784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789265663.491837:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417638016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265663.491844:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789265663.491872:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417638144 00000100:00100000:2.0:1789265663.491877:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417638144 00000100:00100000:2.0:1789265663.493004:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265663.493015:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417638144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265663.493215:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789265663.493278:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417638144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 265us (3510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265663.493285:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789265663.493475:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265663.493517:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417638016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265663.494495:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417638144:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789265663.873241:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265664.900614:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265665.537201:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417638400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265665.537265:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265665.537315:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265665.537321:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417638528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265665.537344:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265665.537385:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417638400 00000100:00100000:3.0:1789265665.537392:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417638400 00000100:00100000:3.0:1789265665.537439:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417638528 00000100:00100000:3.0:1789265665.537442:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417638528 00000100:00100000:3.0:1789265665.537460:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265665.537470:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417638400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265665.537500:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789265665.537543:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417638400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265665.537562:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789265665.537578:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789265665.537585:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876180417638528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265665.537596:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789265665.537620:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876180417638528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265665.537626:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789265665.537644:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265665.537675:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417638528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265665.537688:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417638400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265665.538259:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82fe313a-a4f8-4781-be1f-82c20160e337:3643:1876180417638656:0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.538294:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265665.538319:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417639168:0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.538340:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265665.538354:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417639680:0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.538374:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265665.538391:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789265665.538396:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417638784:0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.538452:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265665.538466:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417639296:0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.538486:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265665.538499:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83dab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417639808:0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.538517:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265665.538548:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417638656 00000100:00100000:2.0:1789265665.538552:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417638656 00000100:00100000:2.0:1789265665.538584:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789265665.538591:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+24:3643:x1876180417638656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.538626:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+24:3643:x1876180417638656:12345-0@lo:400:kworker.0 Request processed in 35us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265665.538639:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789265665.538668:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417639680 00000100:00100000:2.0:1789265665.538672:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417639680 00000100:00100000:2.0:1789265665.538698:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417639808 00000100:00100000:2.0:1789265665.538702:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417639808 00000100:00100000:2.0:1789265665.538714:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789265665.538719:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417639680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.538759:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876180417639680:12345-0@lo:400:kworker.0 Request processed in 40us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265665.538766:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789265665.538777:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265665.538782:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417639808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.538803:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417639808:12345-0@lo:400:kworker.0 Request processed in 21us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265665.538808:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789265665.538831:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417639168 00000100:00100000:2.0:1789265665.538834:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417639168 00000100:00100000:2.0:1789265665.538852:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417638784 00000100:00100000:2.0:1789265665.538854:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417638784 00000100:00100000:2.0:1789265665.538864:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789265665.538869:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417639168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.538895:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417639168:12345-0@lo:400:kworker.0 Request processed in 26us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265665.538901:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789265665.538910:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789265665.538914:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417638784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.538944:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417638784:12345-0@lo:400:kworker.0 Request processed in 30us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265665.538949:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789265665.538973:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417639040:0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.538995:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265665.539012:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417639552:0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.539052:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265665.539068:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789265665.539073:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417638912:0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.539101:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265665.539115:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417639424:0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.539135:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265665.539147:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417639936:0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.539166:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265665.539194:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417639040 00000100:00100000:2.0:1789265665.539197:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417639040 00000100:00100000:2.0:1789265665.539213:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417639552 00000100:00100000:2.0:1789265665.539215:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417639552 00000100:00100000:2.0:1789265665.539227:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417639424 00000100:00100000:2.0:1789265665.539229:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417639424 00000100:00100000:2.0:1789265665.539239:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417639936 00000100:00100000:2.0:1789265665.539241:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417639936 00000100:00100000:2.0:1789265665.539253:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265665.539259:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417639040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265665.539275:0:22759:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789265665.539284:0:22759:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789265665.539308:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417639040:12345-0@lo:400:kworker.0 Request processed in 47us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265665.539315:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789265665.539335:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265665.539341:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417639552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.539371:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417639552:12345-0@lo:400:kworker.0 Request processed in 30us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265665.539377:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789265665.539389:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789265665.539396:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417639424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265665.539418:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789265665.539423:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417639424:12345-0@lo:400:kworker.0 Request processed in 26us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265665.539430:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417639936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.539432:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1789265665.539453:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265665.539458:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265665.539467:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417639936:12345-0@lo:400:kworker.0 Request processed in 41us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265665.539473:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1789265665.539488:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83da8000 x1876180417639424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265665.539501:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417639424:0@lo:400:kworker.0 00010000:00080000:2.0:1789265665.539514:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83da9f80 x1876180417639936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265665.539523:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417639936:0@lo:400:kworker.0 00010000:00080000:2.0:1789265665.539533:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e98e00 x1876180417639040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265665.539541:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417639040:0@lo:400:kworker.0 00010000:00080000:2.0:1789265665.539549:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83da9880 x1876180417639552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265665.539556:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417639552:0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.539607:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417638784:0@lo:400:kworker.0 00010000:00080000:2.0:1789265665.539617:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83dab800 x1876180417639808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265665.539626:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83dab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417639808:0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.539633:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82fe313a-a4f8-4781-be1f-82c20160e337:3643:1876180417638656:0@lo:400:kworker.0 00000100:00100000:2.0:1789265665.539642:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417639168:0@lo:400:kworker.0 00010000:00080000:2.0:1789265665.539651:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83da8700 x1876180417639680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265665.539659:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876180417639680:0@lo:400:kworker.0 00000100:00100000:1.0:1789265665.539808:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417640064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265665.539813:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417639296 00000100:00100000:0.0:1789265665.539819:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417639296 00000100:00100000:1.0:1789265665.539840:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265665.539861:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417638912 00000100:00100000:0.0:1789265665.539865:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417638912 00000100:00100000:0.0:1789265665.539895:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265665.539903:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417639296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265665.539943:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417639296:12345-0@lo:400:kworker.0 Request processed in 42us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265665.539950:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789265665.539963:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789265665.539970:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417638912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265665.540001:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417638912:12345-0@lo:400:kworker.0 Request processed in 32us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265665.540007:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789265665.540079:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265665.540100:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417639296:0@lo:400:kworker.0 00000100:00100000:0.0:1789265665.540123:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417638912:0@lo:400:kworker.0 00000100:00100000:0.0:1789265665.541168:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417640064 00000100:00100000:0.0:1789265665.541176:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417640064 00000100:00100000:0.0:1789265665.541212:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789265665.541219:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417640064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265665.541239:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789265665.541295:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417640064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265665.541312:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789265665.541394:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417640064:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789265665.920657:0:25437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg349-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789265665.936409:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265666.242787:0:22793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1789265666.568430:0:25080:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:0.0:1789265666.945371:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789265667.165225:0:25490:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789265667.165407:0:25490:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789265667.970234:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789265668.152445:0:25540:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789265668.152720:0:25540:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789265668.408281:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265668.408356:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399703296 00000100:00100000:0.0:1789265668.408370:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399703296 00000100:00100000:0.0:1789265668.408425:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 116 00000100:00100000:0.0:1789265668.408436:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2392:x1876180399703296:12345-192.168.203.49@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789265668.408473:0:22753:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5e10fc26-9cb2-4fc3-a83c-10bb2defac1a@192.168.203.49@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:0.0:1789265668.408511:0:22753:0:(genops.c:1385:class_connect()) connect: client 5e10fc26-9cb2-4fc3-a83c-10bb2defac1a, cookie 0x9272d942b4a984e2 00000100:00080000:0.0:1789265668.408695:0:22753:0:(import.c:65:import_set_state_nolock()) ffff9fcb82f8c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265668.408811:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+5:2392:x1876180399703296:12345-192.168.203.49@tcp:250:mount.lustre.0 Request processed in 375us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265668.408820:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 116 00000100:00100000:0.0:1789265668.415242:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265668.415320:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399703424 00000100:00100000:3.0:1789265668.415332:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399703424 00000100:00100000:3.0:1789265668.415394:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 117 00000100:00100000:3.0:1789265668.415405:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+5:18062:x1876180399703424:12345-192.168.203.49@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789265668.415426:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265668.415448:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f53000/0x9272d942b4a984e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc31c expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265668.415502:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f53000/0x9272d942b4a984e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc31c expref: 6 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265668.415516:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f53000/0x9272d942b4a984e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc31c expref: 6 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265668.415547:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f53000, rc 0) 00000100:00100000:3.0:1789265668.415627:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+6:18062:x1876180399703424:12345-192.168.203.49@tcp:101:mount.lustre.0 Request processed in 224us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265668.415636:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 117 00000100:00100000:3.0:1789265668.421344:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265668.421388:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399703552 00000100:00100000:3.0:1789265668.421401:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399703552 00000100:00100000:3.0:1789265668.421456:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 118 00000100:00100000:3.0:1789265668.421467:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+6:18062:x1876180399703552:12345-192.168.203.49@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789265668.421604:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+6:18062:x1876180399703552:12345-192.168.203.49@tcp:501:mount.lustre.0 Request processed in 138us (273us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789265668.421613:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 118 00000100:00100000:3.0:1789265668.439695:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265668.440126:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399703680 00000100:00100000:0.0:1789265668.440141:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399703680 00000100:00100000:0.0:1789265668.440200:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 119 00000100:00100000:0.0:1789265668.440211:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+6:18062:x1876180399703680:12345-192.168.203.49@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789265668.440233:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265668.440269:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc80031a00/0x9272d942b4a984f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc323 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265668.440310:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc80031a00/0x9272d942b4a984f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc323 expref: 7 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265668.440324:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc80031a00/0x9272d942b4a984f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc323 expref: 7 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265668.440352:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc80031a00, rc 0) 00000100:00100000:0.0:1789265668.440425:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+7:18062:x1876180399703680:12345-192.168.203.49@tcp:101:mount.lustre.0 Request processed in 215us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265668.440433:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 119 00000100:00100000:3.0:1789265668.445647:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265668.445887:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399703808 00000100:00100000:0.0:1789265668.445901:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399703808 00000100:00100000:1.0:1789265668.446200:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 120 00000100:00100000:1.0:1789265668.446215:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+7:18062:x1876180399703808:12345-192.168.203.49@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789265668.446428:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+8:18062:x1876180399703808:12345-192.168.203.49@tcp:501:mount.lustre.0 Request processed in 217us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265668.446438:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 120 00000100:00100000:0.0:1789265668.453559:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265668.453861:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399703936 00000100:00100000:3.0:1789265668.453874:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399703936 00000100:00100000:3.0:1789265668.453977:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 121 00000100:00100000:3.0:1789265668.453989:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+8:18062:x1876180399703936:12345-192.168.203.49@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789265668.454353:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+8:18062:x1876180399703936:12345-192.168.203.49@tcp:503:mount.lustre.0 Request processed in 365us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265668.454363:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 121 00000100:00100000:2.0:1789265668.463549:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265668.463680:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399704064 00000100:00100000:1.0:1789265668.463692:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399704064 00000100:00100000:1.0:1789265668.463761:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 122 00000100:00100000:1.0:1789265668.463772:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+8:18080:x1876180399704064:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789265668.463991:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+8:18080:x1876180399704064:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 219us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265668.464001:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 122 00000100:00100000:1.0:1789265668.495338:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265668.495480:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399704192 00000100:00100000:3.0:1789265668.495494:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399704192 00000100:00100000:3.0:1789265668.495569:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 123 00000100:00100000:3.0:1789265668.495581:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+8:18080:x1876180399704192:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265668.498086:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+8:18080:x1876180399704192:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 2485us (2740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265668.498107:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 123 00000100:00100000:3.0:1789265668.507425:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265668.507574:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399704320 00000100:00100000:0.0:1789265668.507590:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399704320 00000100:00100000:0.0:1789265668.507672:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 124 00000100:00100000:0.0:1789265668.507686:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+8:18080:x1876180399704320:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265668.507952:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+8:18080:x1876180399704320:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 262us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265668.507961:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 124 00000100:00100000:2.0:1789265668.517609:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265668.517713:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399704448 00000100:00100000:0.0:1789265668.517729:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399704448 00000100:00100000:0.0:1789265668.517795:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 125 00000100:00100000:0.0:1789265668.517806:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb821ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+8:18062:x1876180399704448:12345-192.168.203.49@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789265668.517827:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265668.517849:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc80031000/0x9272d942b4a984f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc354 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265668.517908:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc80031000/0x9272d942b4a984f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc354 expref: 9 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265668.517921:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc80031000/0x9272d942b4a984f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc354 expref: 9 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265668.517933:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc80031000, rc 0) 00000100:00100000:0.0:1789265668.518015:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb821ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+9:18062:x1876180399704448:12345-192.168.203.49@tcp:101:mount.lustre.0 Request processed in 210us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265668.518051:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 125 00000100:00100000:3.0:1789265668.523376:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265668.523572:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399704576 00000100:00100000:1.0:1789265668.523586:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399704576 00000100:00100000:1.0:1789265668.523659:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 126 00000100:00100000:1.0:1789265668.523670:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaea74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+9:18062:x1876180399704576:12345-192.168.203.49@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789265668.523715:0:22754:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789265668.523750:0:22754:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789265668.523754:0:22754:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789265668.523757:0:22754:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789265668.523766:0:22754:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789265668.523769:0:22754:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1789265668.527852:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaea74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+9:18062:x1876180399704576:12345-192.168.203.49@tcp:256:mount.lustre.0 Request processed in 4165us (4472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265668.527871:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 126 00000100:00100000:2.0:1789265668.537740:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265668.537855:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399704704 00000100:00100000:3.0:1789265668.537869:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399704704 00000100:00100000:3.0:1789265668.537990:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 127 00000100:00100000:3.0:1789265668.538002:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaea77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+9:18062:x1876180399704704:12345-192.168.203.49@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789265668.538075:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265668.538099:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f52a00/0x9272d942b4a984fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc35b expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265668.538136:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f52a00/0x9272d942b4a984fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc35b expref: 10 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265668.538150:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f52a00/0x9272d942b4a984fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc35b expref: 10 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265668.538161:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f52a00, rc 0) 00000100:00100000:3.0:1789265668.538225:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaea77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+10:18062:x1876180399704704:12345-192.168.203.49@tcp:101:mount.lustre.0 Request processed in 225us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265668.538233:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 127 00000100:00100000:1.0:1789265668.545655:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265668.545818:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399704832 00000100:00100000:3.0:1789265668.545833:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399704832 00000100:00100000:3.0:1789265668.545894:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 128 00000100:00100000:3.0:1789265668.545905:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc85816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+10:18062:x1876180399704832:12345-192.168.203.49@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789265668.548580:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc85816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+10:18062:x1876180399704832:12345-192.168.203.49@tcp:501:mount.lustre.0 Request processed in 2660us (2924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265668.548598:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 128 00000100:00100000:1.0:1789265668.551780:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265668.551929:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399704960 00000100:00100000:3.0:1789265668.551943:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399704960 00000100:00100000:2.0:1789265668.553733:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 129 00000100:00100000:2.0:1789265668.553760:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc87ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+10:18062:x1876180399704960:12345-192.168.203.49@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789265668.554797:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc87ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+10:18062:x1876180399704960:12345-192.168.203.49@tcp:503:mount.lustre.0 Request processed in 1040us (3026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265668.554823:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 129 00000100:00100000:3.0:1789265668.570795:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265668.571388:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399705088 00000100:00100000:2.0:1789265668.571401:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399705088 00000100:00100000:2.0:1789265668.571469:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 130 00000100:00100000:2.0:1789265668.571480:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+10:18085:x1876180399705088:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265668.571802:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+10:18085:x1876180399705088:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 322us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265668.571811:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 130 00000100:00100000:1.0:1789265668.580214:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265668.580341:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399705216 00000100:00100000:2.0:1789265668.580355:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399705216 00000100:00100000:2.0:1789265668.580425:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 131 00000100:00100000:2.0:1789265668.580436:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+10:18085:x1876180399705216:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265668.580641:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+10:18085:x1876180399705216:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 205us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265668.580651:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 131 00000100:00100000:1.0:1789265668.592484:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265668.593005:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399705344 00000100:00100000:2.0:1789265668.593019:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399705344 00000100:00100000:1.0:1789265668.593094:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265668.598067:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399705600 00000100:00100000:3.0:1789265668.598086:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399705600 00000100:00100000:2.0:1789265668.598253:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:2.0:1789265668.598263:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2392:x1876180399705344:12345-192.168.203.49@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789265668.598299:0:22761:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c0c77789-04ce-4c79-87b2-012b259e18c5@192.168.203.49@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:2.0:1789265668.598358:0:22761:0:(genops.c:1385:class_connect()) connect: client c0c77789-04ce-4c79-87b2-012b259e18c5, cookie 0x9272d942b4a98505 00000004:00100000:2.0:1789265668.598388:0:22761:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789265668.598646:0:22761:0:(import.c:65:import_set_state_nolock()) ffff9fcb83eae800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265668.598755:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+6:2392:x1876180399705344:12345-192.168.203.49@tcp:38:mount.lustre.0 Request processed in 492us (6288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265668.598782:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:2.0:1789265668.598804:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:2.0:1789265668.598810:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2392:x1876180399705600:12345-192.168.203.49@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789265668.598828:0:22761:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c0c77789-04ce-4c79-87b2-012b259e18c5@192.168.203.49@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:2.0:1789265668.598866:0:22761:0:(genops.c:1385:class_connect()) connect: client c0c77789-04ce-4c79-87b2-012b259e18c5, cookie 0x9272d942b4a9850c 00000004:00100000:2.0:1789265668.598880:0:22761:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789265668.599047:0:22761:0:(import.c:65:import_set_state_nolock()) ffff9fcb83eab800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265668.599076:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+6:2392:x1876180399705600:12345-192.168.203.49@tcp:38:mount.lustre.0 Request processed in 264us (5992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265668.599082:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:3.0:1789265668.609521:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789265668.609551:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417640192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265668.609641:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265668.609651:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417640448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265668.609687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265668.609692:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417640320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265668.609732:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265668.609750:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417640192 00000100:00100000:2.0:1789265668.609760:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417640192 00000100:00100000:3.0:1789265668.609763:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417640320 00000100:00100000:3.0:1789265668.609765:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417640320 00000100:00100000:2.0:1789265668.609807:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417640448 00000100:00100000:2.0:1789265668.609810:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417640448 00000100:00100000:3.0:1789265668.609812:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265668.609822:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417640320:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265668.609825:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789265668.609831:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417640192:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:3.0:1789265668.609857:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000004:00000024:2.0:1789265668.609857:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789265668.609936:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789265668.609951:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417640448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265668.609976:0:23784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789265668.610019:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417640320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 198us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265668.610039:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417640192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 190us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265668.610047:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789265668.610052:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789265668.610071:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265668.610121:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417640320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265668.610136:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417640192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265668.610646:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417640448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 700us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265668.610653:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789265668.610956:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417640448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265668.616668:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265668.619294:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399705472 00000100:00100000:1.0:1789265668.619318:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399705472 00000100:00080000:3.0:1789265668.619417:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789265668.619430:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:1.0:1789265668.619443:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+6:0:x1876180399705472:12345-192.168.203.49@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789265668.619484:0:22759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789265668.619733:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+6:0:x1876180399705472:12345-192.168.203.49@tcp:41:mount.lustre.0 Request processed in 291us (3082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265668.619741:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:0.0:1789265668.623004:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265668.623205:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265668.623225:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399705856 00000100:00100000:1.0:1789265668.623238:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399705856 00000100:00100000:1.0:1789265668.623349:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 10 00000100:00100000:1.0:1789265668.623360:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+6:18062:x1876180399705856:12345-192.168.203.49@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789265668.623399:0:25384:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789265668.623478:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+6:18062:x1876180399705856:12345-192.168.203.49@tcp:41:mount.lustre.0 Request processed in 121us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265668.623486:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 10 00000100:00100000:2.0:1789265668.624167:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399705728 00000100:00100000:2.0:1789265668.624191:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399705728 00000100:00100000:2.0:1789265668.624287:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00100000:2.0:1789265668.624296:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+6:0:x1876180399705728:12345-192.168.203.49@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789265668.624320:0:22760:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789265668.624392:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+6:0:x1876180399705728:12345-192.168.203.49@tcp:41:mount.lustre.0 Request processed in 97us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265668.624400:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00080000:0.0:1789265668.624836:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265668.638598:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265668.638961:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399705984 00000100:00100000:1.0:1789265668.638983:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399705984 00000100:00100000:1.0:1789265668.639092:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:1.0:1789265668.639103:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+6:18062:x1876180399705984:12345-192.168.203.49@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789265668.639191:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+6:18062:x1876180399705984:12345-192.168.203.49@tcp:40:mount.lustre.0 Request processed in 91us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265668.639205:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:1.0:1789265668.649822:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265668.649863:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265668.649888:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265668.649971:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399706112 00000100:00100000:2.0:1789265668.649981:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399706112 00000100:00100000:0.0:1789265668.650018:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399706368 00000100:00100000:0.0:1789265668.650052:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399706368 00000100:00100000:2.0:1789265668.650053:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399706240 00000100:00100000:2.0:1789265668.650058:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399706240 00000100:00100000:2.0:1789265668.650083:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:2.0:1789265668.650092:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1876180399706112:12345-192.168.203.49@tcp:8:mount.lustre.0 00000100:00100000:0.0:1789265668.650100:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:0.0:1789265668.650109:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c0c77789-04ce-4c79-87b2-012b259e18c5+6:18062:x1876180399706368:12345-192.168.203.49@tcp:900:mount.lustre.0 00010000:00080000:2.0:1789265668.650124:0:24264:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c0c77789-04ce-4c79-87b2-012b259e18c5@192.168.203.49@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:2.0:1789265668.650154:0:24264:0:(genops.c:1385:class_connect()) connect: client c0c77789-04ce-4c79-87b2-012b259e18c5, cookie 0x9272d942b4a98513 00002000:00100000:2.0:1789265668.650165:0:24264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c0c77789-04ce-4c79-87b2-012b259e18c5/ffff9fcb83eaf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265668.650175:0:24264:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789265668.650180:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c0c77789-04ce-4c79-87b2-012b259e18c5+6:18062:x1876180399706368:12345-192.168.203.49@tcp:900:mount.lustre.0 Request processed in 69us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265668.650189:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:0.0:1789265668.650226:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:0.0:1789265668.650233:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1876180399706240:12345-192.168.203.49@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789265668.650263:0:24266:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c0c77789-04ce-4c79-87b2-012b259e18c5@192.168.203.49@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:0.0:1789265668.650286:0:24266:0:(genops.c:1385:class_connect()) connect: client c0c77789-04ce-4c79-87b2-012b259e18c5, cookie 0x9272d942b4a9851a 00002000:00100000:0.0:1789265668.650293:0:24266:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c0c77789-04ce-4c79-87b2-012b259e18c5/ffff9fcb82f8a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789265668.650307:0:24266:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789265668.650375:0:24264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789265668.650417:0:24264:0:(import.c:65:import_set_state_nolock()) ffff9fcb83eab000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265668.650463:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+6:2392:x1876180399706112:12345-192.168.203.49@tcp:8:mount.lustre.0 Request processed in 370us (598us total) trans 0 rc 0/0 00002000:00080000:0.0:1789265668.650466:0:24266:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1789265668.650473:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00080000:0.0:1789265668.650485:0:24266:0:(import.c:65:import_set_state_nolock()) ffff9fcb82f8c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789265668.650513:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+6:2392:x1876180399706240:12345-192.168.203.49@tcp:8:mount.lustre.0 Request processed in 279us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265668.650520:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:0.0:1789265668.652685:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265668.653422:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399706496 00000100:00100000:2.0:1789265668.653432:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399706496 00000100:00100000:2.0:1789265668.653480:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:2.0:1789265668.653491:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+6:18062:x1876180399706496:12345-192.168.203.49@tcp:33:mount.lustre.0 00000004:00080000:0.0:1789265668.655224:0:22762:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1628us 00000004:00200000:0.0:1789265668.678884:0:22762:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789265668.679019:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+6:18062:x1876180399706496:12345-192.168.203.49@tcp:33:mount.lustre.0 Request processed in 25514us (26326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265668.679058:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:0.0:1789265668.820120:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265668.820226:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399706624 00000100:00100000:2.0:1789265668.820240:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399706624 00000100:00100000:2.0:1789265668.820372:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:2.0:1789265668.820385:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+6:18108:x1876180399706624:12345-192.168.203.49@tcp:101:mkdir.0 00010000:00010000:2.0:1789265668.820404:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265668.820428:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a98521 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc38c expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265668.820492:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98528 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265668.820507:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265668.820522:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265668.820565:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789265668.820569:0:22760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265668.820627:0:22760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265668.820653:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a98521 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc38c expref: 8 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265668.820675:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98528 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc38c expref: 7 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265668.820684:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcb83b85800) 00010000:00010000:2.0:1789265668.820692:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265668.820696:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490600, rc 0) 00000100:00100000:2.0:1789265668.820771:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+7:18108:x1876180399706624:12345-192.168.203.49@tcp:101:mkdir.0 Request processed in 390us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265668.820778:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 13 00010000:00010000:0.0:1789265668.993409:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265669.377863:0:23512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789265670.039077:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265670.657462:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417640704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789265670.657509:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417640832:0@lo:400:kworker.0 00000100:00100000:2.0:1789265670.657565:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265670.657612:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265670.657625:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82fe313a-a4f8-4781-be1f-82c20160e337:3642:1876180417640576:0@lo:400:kworker.0 00000100:00100000:2.0:1789265670.657661:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcc837e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417641216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265670.657677:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417641344:0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.657685:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265670.657734:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417641088:0@lo:400:kworker.0 00000100:00100000:2.0:1789265670.657743:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265670.657782:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417641728:0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.657785:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265670.657973:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265670.657999:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417642240:0@lo:400:kworker.0 00000100:00100000:2.0:1789265670.658047:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265670.658070:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789265670.658077:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417641856:0@lo:400:kworker.0 00000100:00100000:2.0:1789265670.658132:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265670.658158:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417642368:0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.658179:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417641600:0@lo:400:kworker.0 00000100:00100000:2.0:1789265670.658193:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265670.658240:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417640960:0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.658248:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265670.658295:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417642112:0@lo:400:kworker.0 00000100:00100000:2.0:1789265670.658307:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265670.658344:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417641472:0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.658353:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265670.658394:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265670.658430:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccaa290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417641984:0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.658433:0:24771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417641088 00000100:00100000:1.0:1789265670.658444:0:24771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417641088 00000100:00100000:2.0:1789265670.658458:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265670.658523:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417640832 00000100:00100000:1.0:1789265670.658530:0:24771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417641728 00000100:00100000:2.0:1789265670.658532:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417640832 00000100:00100000:1.0:1789265670.658537:0:24771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417641728 00000100:00100000:1.0:1789265670.658572:0:24771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417641600 00000100:00100000:1.0:1789265670.658576:0:24771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417641600 00000100:00100000:2.0:1789265670.658593:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417641472 00000100:00100000:2.0:1789265670.658600:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417641472 00000100:00100000:1.0:1789265670.658617:0:24771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417640960 00000100:00100000:1.0:1789265670.658624:0:24771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417640960 00000100:00100000:2.0:1789265670.658633:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789265670.658652:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417640832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.658660:0:24771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789265670.658673:0:24771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417641088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.658754:0:24771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417641088:12345-0@lo:400:kworker.0 Request processed in 84us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265670.658786:0:24771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789265670.658787:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417640832:12345-0@lo:400:kworker.0 Request processed in 139us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265670.658801:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789265670.658823:0:24771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265670.658842:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789265670.658843:0:24771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417641728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265670.658858:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417641472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.658917:0:24771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417641728:12345-0@lo:400:kworker.0 Request processed in 81us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265670.658966:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417641472:12345-0@lo:400:kworker.0 Request processed in 112us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265670.658974:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789265670.658995:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417640576 00000100:00100000:2.0:1789265670.659000:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417640576 00000100:00100000:2.0:1789265670.659046:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789265670.659053:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+24:3642:x1876180417640576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265670.659085:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+24:3642:x1876180417640576:12345-0@lo:400:kworker.0 Request processed in 32us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265670.659090:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789265670.659180:0:24771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789265670.659195:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789265670.659209:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417641600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.659215:0:24771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789265670.659237:0:24771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417640960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265670.659266:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417641600:12345-0@lo:400:kworker.0 Request processed in 58us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265670.659275:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789265670.659303:0:24771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417640960:12345-0@lo:400:kworker.0 Request processed in 70us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265670.659309:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417642240 00000100:00100000:1.0:1789265670.659313:0:24771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789265670.659323:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417642240 00000100:00080000:1.0:1789265670.659350:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265670.659354:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417641856 00000100:00080000:1.0:1789265670.659358:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789265670.659359:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417641856 00000100:00080000:1.0:1789265670.659364:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265670.659388:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417642368 00000100:00100000:2.0:1789265670.659394:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417642368 00000100:00100000:1.0:1789265670.659412:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82fe313a-a4f8-4781-be1f-82c20160e337:3642:1876180417640576:0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.659431:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1789265670.659435:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417642112 00000100:00100000:2.0:1789265670.659442:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417642112 00000100:00100000:1.0:1789265670.659458:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417641088:0@lo:400:kworker.0 00000100:00100000:2.0:1789265670.659463:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417641984 00000100:00100000:2.0:1789265670.659468:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417641984 00000100:00100000:1.0:1789265670.659480:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417641600:0@lo:400:kworker.0 00000100:00100000:2.0:1789265670.659500:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789265670.659510:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417642240:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789265670.659515:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265670.659520:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789265670.659542:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789265670.659557:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417641856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265670.659566:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876180417642240:12345-0@lo:400:kworker.0 Request processed in 52us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265670.659575:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789265670.659593:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789265670.659602:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417642368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.659630:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417641856:12345-0@lo:400:kworker.0 Request processed in 77us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265670.659657:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789265670.659665:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417642368:12345-0@lo:400:kworker.0 Request processed in 53us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265670.659687:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265670.659706:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417642112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.659753:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876180417642112:12345-0@lo:400:kworker.0 Request processed in 49us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265670.659759:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789265670.659772:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789265670.659779:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417641984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.659809:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417641984:12345-0@lo:400:kworker.0 Request processed in 32us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265670.659815:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1789265670.659846:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccaa291c00 x1876180417642112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265670.659859:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876180417642112:0@lo:400:kworker.0 00000100:00100000:3.0:1789265670.659906:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265670.659951:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417640832:0@lo:400:kworker.0 00000100:00100000:3.0:1789265670.660072:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417640704 00000100:00100000:3.0:1789265670.660078:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417640704 00000100:00100000:3.0:1789265670.660106:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417641216 00000100:00100000:3.0:1789265670.660109:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417641216 00000100:00100000:3.0:1789265670.660122:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265670.660128:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417640704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265670.660155:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789265670.660192:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417640704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (2633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265670.660199:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789265670.660211:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265670.660217:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417641216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789265670.660233:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789265670.660260:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417641216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (2524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265670.660266:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265670.660298:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417641344 00000100:00100000:3.0:1789265670.660302:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417641344 00000100:00100000:3.0:1789265670.660319:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789265670.660324:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb84845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417641344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265670.660370:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb84845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876180417641344:12345-0@lo:400:kworker.0 Request processed in 45us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265670.661919:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417640960:0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.662019:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417641472:0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.662058:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417641984:0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.662127:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417641856:0@lo:400:kworker.0 00000100:00100000:3.0:1789265670.662130:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789265670.662147:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccaa291880 x1876180417642368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265670.662159:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417642368:0@lo:400:kworker.0 00000100:00100000:2.0:1789265670.662170:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789265670.662193:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcc837e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417641216:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265670.662287:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876180417641344:0@lo:400:kworker.0 00000100:00100000:2.0:1789265670.663058:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417642496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789265670.663084:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417641728:0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.663111:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccaa290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876180417642240:0@lo:400:kworker.0 00000100:00100000:1.0:1789265670.663130:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417640704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789265670.663200:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265670.663343:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417642496 00000100:00100000:0.0:1789265670.663350:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417642496 00000100:00100000:0.0:1789265670.663399:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789265670.663408:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417642496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265670.663428:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1789265670.663518:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417642496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265670.663542:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265670.663619:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417642496:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789265671.044868:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265671.091642:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265671.091738:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399706752 00000100:00100000:1.0:1789265671.091752:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399706752 00000100:00100000:1.0:1789265671.091881:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00100000:1.0:1789265671.091897:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+7:18160:x1876180399706752:12345-192.168.203.49@tcp:41:lfs.0 00000004:00000024:1.0:1789265671.091962:0:22759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789265671.092147:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+7:18160:x1876180399706752:12345-192.168.203.49@tcp:41:lfs.0 Request processed in 254us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265671.092156:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00080000:2.0:1789265671.092302:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265671.105128:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265671.105230:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399706880 00000100:00100000:2.0:1789265671.105244:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399706880 00000100:00100000:2.0:1789265671.105541:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00100000:2.0:1789265671.105552:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+6:18160:x1876180399706880:12345-192.168.203.49@tcp:41:lfs.0 00000004:00000024:2.0:1789265671.105599:0:22760:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789265671.105700:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+6:18160:x1876180399706880:12345-192.168.203.49@tcp:41:lfs.0 Request processed in 150us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265671.105708:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00080000:1.0:1789265671.106062:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265671.120019:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265671.120153:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399707008 00000100:00100000:1.0:1789265671.120163:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399707008 00000100:00100000:1.0:1789265671.120237:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:1.0:1789265671.120248:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0c77789-04ce-4c79-87b2-012b259e18c5+6:18160:x1876180399707008:12345-192.168.203.49@tcp:13:lfs.0 00002000:00000024:1.0:1789265671.120285:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789265671.120389:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0c77789-04ce-4c79-87b2-012b259e18c5+6:18160:x1876180399707008:12345-192.168.203.49@tcp:13:lfs.0 Request processed in 143us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265671.120397:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00080000:2.0:1789265671.121583:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265671.128885:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265671.129171:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399707136 00000100:00100000:1.0:1789265671.129180:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399707136 00000100:00100000:1.0:1789265671.129287:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00100000:1.0:1789265671.129297:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0c77789-04ce-4c79-87b2-012b259e18c5+6:18160:x1876180399707136:12345-192.168.203.49@tcp:13:lfs.0 00002000:00000024:1.0:1789265671.129342:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789265671.129448:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c0c77789-04ce-4c79-87b2-012b259e18c5+6:18160:x1876180399707136:12345-192.168.203.49@tcp:13:lfs.0 Request processed in 146us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265671.129455:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00080000:2.0:1789265671.129637:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265671.408639:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265671.410344:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399707264 00000100:00100000:1.0:1789265671.410364:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399707264 00000100:00100000:1.0:1789265671.410473:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 133 00000100:00100000:1.0:1789265671.410486:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+10:18192:x1876180399707264:12345-192.168.203.49@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789265671.410509:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265671.410535:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccb71c6000/0x9272d942b4a9852f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc393 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265671.410577:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccb71c6000/0x9272d942b4a9852f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc393 expref: 11 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265671.410593:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccb71c6000/0x9272d942b4a9852f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc393 expref: 11 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265671.410604:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb71c6000, rc 0) 00000100:00100000:1.0:1789265671.410709:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+11:18192:x1876180399707264:12345-192.168.203.49@tcp:101:mount.lustre.0 Request processed in 225us (2084us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265671.410717:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 133 00000100:00100000:3.0:1789265671.417873:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265671.418584:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399707392 00000100:00100000:1.0:1789265671.418599:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399707392 00000100:00100000:1.0:1789265671.418693:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 134 00000100:00100000:1.0:1789265671.418705:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+11:18192:x1876180399707392:12345-192.168.203.49@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789265671.418975:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+11:18192:x1876180399707392:12345-192.168.203.49@tcp:501:mount.lustre.0 Request processed in 271us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265671.419002:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 134 00000100:00100000:0.0:1789265671.438887:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265671.450758:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399707520 00000100:00100000:2.0:1789265671.450783:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399707520 00000100:00100000:2.0:1789265671.450885:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 135 00000100:00100000:2.0:1789265671.450898:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+11:18192:x1876180399707520:12345-192.168.203.49@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789265671.452559:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+11:18192:x1876180399707520:12345-192.168.203.49@tcp:503:mount.lustre.0 Request processed in 1649us (13672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265671.452575:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 135 00000100:00100000:3.0:1789265671.460479:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265671.460747:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399707648 00000100:00100000:0.0:1789265671.460760:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399707648 00000100:00100000:0.0:1789265671.460842:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 136 00000100:00100000:0.0:1789265671.460854:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+11:18199:x1876180399707648:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265671.461648:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+11:18199:x1876180399707648:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 789us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265671.461661:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 136 00000100:00100000:3.0:1789265671.491984:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265671.492481:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399707776 00000100:00100000:2.0:1789265671.492494:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399707776 00000100:00100000:2.0:1789265671.492608:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 137 00000100:00100000:2.0:1789265671.492620:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+11:18199:x1876180399707776:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265671.492846:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+11:18199:x1876180399707776:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 228us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265671.492856:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 137 00000100:00100000:1.0:1789265671.505658:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265671.505790:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399707904 00000100:00100000:0.0:1789265671.505804:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399707904 00000100:00100000:0.0:1789265671.505878:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 138 00000100:00100000:0.0:1789265671.505890:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+11:18199:x1876180399707904:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789265671.506164:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+11:18199:x1876180399707904:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 275us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265671.506173:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 138 00000100:00100000:3.0:1789265671.511572:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265671.515320:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399708032 00000100:00100000:2.0:1789265671.515340:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399708032 00000100:00100000:3.0:1789265671.520878:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 139 00000100:00100000:3.0:1789265671.520898:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+11:18192:x1876180399708032:12345-192.168.203.49@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789265671.520925:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265671.521546:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f52000/0x9272d942b4a98536 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc3c4 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265671.521602:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f52000/0x9272d942b4a98536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3c4 expref: 12 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265671.521616:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f52000/0x9272d942b4a98536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3c4 expref: 12 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265671.521628:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f52000, rc 0) 00000100:00100000:3.0:1789265671.521733:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+12:18192:x1876180399708032:12345-192.168.203.49@tcp:101:mount.lustre.0 Request processed in 840us (10176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265671.521742:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 139 00000100:00100000:3.0:1789265671.524410:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265671.524676:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399708160 00000100:00100000:1.0:1789265671.524699:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399708160 00000100:00100000:1.0:1789265671.524769:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 140 00000100:00100000:1.0:1789265671.524781:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+12:18192:x1876180399708160:12345-192.168.203.49@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789265671.524812:0:22753:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789265671.524844:0:22753:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789265671.524849:0:22753:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789265671.524853:0:22753:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789265671.524856:0:22753:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789265671.524858:0:22753:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1789265671.529668:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+12:18192:x1876180399708160:12345-192.168.203.49@tcp:256:mount.lustre.0 Request processed in 4872us (5255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265671.529696:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 140 00000100:00100000:3.0:1789265671.538453:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265671.539918:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399708288 00000100:00100000:2.0:1789265671.539966:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399708288 00000100:00100000:2.0:1789265671.540107:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 141 00000100:00100000:2.0:1789265671.540120:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+12:18192:x1876180399708288:12345-192.168.203.49@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789265671.540141:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265671.540174:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9853d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc3cb expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265671.540212:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9853d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3cb expref: 13 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265671.540235:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9853d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3cb expref: 13 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265671.540245:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490000, rc 0) 00000100:00100000:2.0:1789265671.540320:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:18192:x1876180399708288:12345-192.168.203.49@tcp:101:mount.lustre.0 Request processed in 203us (1883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265671.540327:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 141 00000100:00100000:3.0:1789265671.543297:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265671.543773:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399708416 00000100:00100000:2.0:1789265671.543788:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399708416 00000100:00100000:2.0:1789265671.543866:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 142 00000100:00100000:2.0:1789265671.543878:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:18192:x1876180399708416:12345-192.168.203.49@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789265671.544141:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:18192:x1876180399708416:12345-192.168.203.49@tcp:501:mount.lustre.0 Request processed in 263us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265671.544149:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 142 00000100:00100000:1.0:1789265671.546441:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265671.546584:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399708544 00000100:00100000:0.0:1789265671.546594:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399708544 00000100:00100000:0.0:1789265671.546649:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 143 00000100:00100000:0.0:1789265671.546657:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b08b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:18192:x1876180399708544:12345-192.168.203.49@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789265671.546870:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b08b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:18192:x1876180399708544:12345-192.168.203.49@tcp:503:mount.lustre.0 Request processed in 211us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265671.546879:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 143 00000100:00100000:0.0:1789265671.553114:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265671.553225:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399708672 00000100:00100000:3.0:1789265671.553244:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399708672 00000100:00100000:3.0:1789265671.553316:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 144 00000100:00100000:3.0:1789265671.553328:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:18203:x1876180399708672:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789265671.553544:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:18203:x1876180399708672:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 218us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265671.553554:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 144 00000100:00100000:3.0:1789265671.583249:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265671.584717:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399708800 00000100:00100000:2.0:1789265671.584739:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399708800 00000100:00100000:2.0:1789265671.584832:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 145 00000100:00100000:2.0:1789265671.584843:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:18203:x1876180399708800:12345-192.168.203.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789265671.585108:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:18203:x1876180399708800:12345-192.168.203.49@tcp:502:llog_process_th.0 Request processed in 266us (1886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265671.585117:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 145 00000100:00100000:2.0:1789265671.617188:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265671.617253:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265671.617276:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265671.617297:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265671.617338:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399709824 00000100:00100000:2.0:1789265671.617350:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399709824 00000100:00100000:2.0:1789265671.617422:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:2.0:1789265671.617436:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+6:2393:x1876180399709824:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265671.617526:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+6:2393:x1876180399709824:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 92us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265671.617535:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:2.0:1789265671.617577:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265671.617605:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399708928 00000100:00100000:2.0:1789265671.617608:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399708928 00000100:00100000:2.0:1789265671.617623:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399709184 00000100:00100000:2.0:1789265671.617626:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399709184 00000100:00100000:2.0:1789265671.617633:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399709568 00000100:00100000:2.0:1789265671.617636:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399709568 00000100:00100000:2.0:1789265671.617651:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399709696 00000100:00100000:2.0:1789265671.617654:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399709696 00000100:00100000:2.0:1789265671.617668:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 48 00000100:00100000:2.0:1789265671.617675:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+7:2393:x1876180399709568:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265671.617718:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+7:2393:x1876180399709568:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 43us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265671.617746:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 48 00000100:00100000:2.0:1789265671.617761:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 49 00000100:00100000:2.0:1789265671.617767:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+6:2393:x1876180399709696:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265671.617795:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+6:2393:x1876180399709696:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265671.617802:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 49 00000100:00100000:2.0:1789265671.617814:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:2.0:1789265671.617818:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1876180399708928:12345-192.168.203.49@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789265671.617846:0:22760:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from fed7caf6-20fa-460c-bf48-65425dcf3952@192.168.203.49@tcp t0 exp 0000000000000000 cur 722 last 0 00000020:00000080:2.0:1789265671.617887:0:22760:0:(genops.c:1385:class_connect()) connect: client fed7caf6-20fa-460c-bf48-65425dcf3952, cookie 0x9272d942b4a98544 00000004:00100000:2.0:1789265671.617921:0:22760:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789265671.618550:0:22760:0:(import.c:65:import_set_state_nolock()) ffff9fccb7b50800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265671.618609:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+6:2392:x1876180399708928:12345-192.168.203.49@tcp:38:mount.lustre.0 Request processed in 789us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265671.618618:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:2.0:1789265671.618640:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:2.0:1789265671.618645:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1876180399709184:12345-192.168.203.49@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789265671.618666:0:22760:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from fed7caf6-20fa-460c-bf48-65425dcf3952@192.168.203.49@tcp t0 exp 0000000000000000 cur 722 last 0 00000020:00000080:2.0:1789265671.618726:0:22760:0:(genops.c:1385:class_connect()) connect: client fed7caf6-20fa-460c-bf48-65425dcf3952, cookie 0x9272d942b4a9854b 00000004:00100000:2.0:1789265671.618746:0:22760:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789265671.618795:0:22760:0:(import.c:65:import_set_state_nolock()) ffff9fccb7b53800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265671.618821:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+6:2392:x1876180399709184:12345-192.168.203.49@tcp:38:mount.lustre.0 Request processed in 174us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265671.618837:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:2.0:1789265671.620114:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265671.629499:0:25154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399709952 00000100:00100000:1.0:1789265671.629522:0:25154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399709952 00000100:00100000:1.0:1789265671.629635:0:25154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:1.0:1789265671.629648:0:25154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0c77789-04ce-4c79-87b2-012b259e18c5+6:2393:x1876180399709952:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265671.631075:0:25154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0c77789-04ce-4c79-87b2-012b259e18c5+6:2393:x1876180399709952:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 1418us (10957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265671.631091:0:25154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:3.0:1789265671.637374:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265671.637533:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265671.637570:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265671.637631:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399709312 00000100:00100000:3.0:1789265671.637644:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399709312 00000100:00100000:3.0:1789265671.637723:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399709056 00000100:00100000:3.0:1789265671.637727:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399709056 00000100:00100000:3.0:1789265671.637742:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399709440 00000100:00100000:3.0:1789265671.637745:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399709440 00000100:00100000:3.0:1789265671.637760:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:3.0:1789265671.637770:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+6:0:x1876180399709312:12345-192.168.203.49@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789265671.637808:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265671.637885:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+6:0:x1876180399709312:12345-192.168.203.49@tcp:41:mount.lustre.0 Request processed in 116us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265671.637893:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:3.0:1789265671.637911:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:3.0:1789265671.637917:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+7:0:x1876180399709056:12345-192.168.203.49@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789265671.637930:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789265671.637979:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+7:0:x1876180399709056:12345-192.168.203.49@tcp:41:mount.lustre.0 Request processed in 62us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265671.637986:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:3.0:1789265671.637998:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:3.0:1789265671.638004:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+6:18192:x1876180399709440:12345-192.168.203.49@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789265671.638013:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789265671.638064:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+6:18192:x1876180399709440:12345-192.168.203.49@tcp:41:mount.lustre.0 Request processed in 60us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265671.638070:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00080000:3.0:1789265671.638087:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265671.638092:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265671.641492:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265671.641624:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399710080 00000100:00100000:0.0:1789265671.641637:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399710080 00000100:00100000:0.0:1789265671.641720:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:0.0:1789265671.641732:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+6:18192:x1876180399710080:12345-192.168.203.49@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789265671.641842:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+6:18192:x1876180399710080:12345-192.168.203.49@tcp:40:mount.lustre.0 Request processed in 112us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265671.641851:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:0.0:1789265671.644409:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265671.644451:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265671.644551:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399710208 00000100:00100000:2.0:1789265671.644563:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399710208 00000100:00100000:2.0:1789265671.644620:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399710336 00000100:00100000:2.0:1789265671.644623:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399710336 00000100:00100000:2.0:1789265671.644650:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:2.0:1789265671.644661:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1876180399710208:12345-192.168.203.49@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789265671.644713:0:24264:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fed7caf6-20fa-460c-bf48-65425dcf3952@192.168.203.49@tcp t0 exp 0000000000000000 cur 722 last 0 00000020:00000080:2.0:1789265671.644753:0:24264:0:(genops.c:1385:class_connect()) connect: client fed7caf6-20fa-460c-bf48-65425dcf3952, cookie 0x9272d942b4a98552 00002000:00100000:2.0:1789265671.644767:0:24264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fed7caf6-20fa-460c-bf48-65425dcf3952/ffff9fccb7b54000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265671.644780:0:24264:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789265671.644856:0:24264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789265671.644890:0:24264:0:(import.c:65:import_set_state_nolock()) ffff9fccb7b52800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265671.644971:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fed7caf6-20fa-460c-bf48-65425dcf3952+6:2392:x1876180399710208:12345-192.168.203.49@tcp:8:mount.lustre.0 Request processed in 310us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265671.644978:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:2.0:1789265671.644996:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:2.0:1789265671.645001:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1876180399710336:12345-192.168.203.49@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789265671.645080:0:24264:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fed7caf6-20fa-460c-bf48-65425dcf3952@192.168.203.49@tcp t0 exp 0000000000000000 cur 722 last 0 00000020:00000080:2.0:1789265671.645098:0:24264:0:(genops.c:1385:class_connect()) connect: client fed7caf6-20fa-460c-bf48-65425dcf3952, cookie 0x9272d942b4a98559 00002000:00100000:2.0:1789265671.645104:0:24264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fed7caf6-20fa-460c-bf48-65425dcf3952/ffff9fccb7b55800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789265671.645110:0:24264:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789265671.645154:0:24264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789265671.645168:0:24264:0:(import.c:65:import_set_state_nolock()) ffff9fccb7b55000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789265671.645191:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fed7caf6-20fa-460c-bf48-65425dcf3952+6:2392:x1876180399710336:12345-192.168.203.49@tcp:8:mount.lustre.0 Request processed in 189us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265671.645199:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:3.0:1789265671.647346:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265671.647483:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399710464 00000100:00100000:0.0:1789265671.647495:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399710464 00000100:00100000:0.0:1789265671.647565:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:0.0:1789265671.647576:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fed7caf6-20fa-460c-bf48-65425dcf3952+6:18192:x1876180399710464:12345-192.168.203.49@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789265671.647674:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fed7caf6-20fa-460c-bf48-65425dcf3952+6:18192:x1876180399710464:12345-192.168.203.49@tcp:900:mount.lustre.0 Request processed in 99us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265671.647690:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:2.0:1789265671.655726:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265671.655901:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399710592 00000100:00100000:0.0:1789265671.655915:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399710592 00000100:00100000:0.0:1789265671.655990:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1 00000100:00100000:0.0:1789265671.656004:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+6:18192:x1876180399710592:12345-192.168.203.49@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789265671.656158:0:22763:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789265671.656493:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+6:18192:x1876180399710592:12345-192.168.203.49@tcp:33:mount.lustre.0 Request processed in 491us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265671.656503:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1 00000100:00100000:3.0:1789265671.869434:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265671.869651:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399710720 00000100:00100000:0.0:1789265671.869666:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399710720 00000100:00100000:0.0:1789265671.869757:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 22 00000100:00100000:0.0:1789265671.869770:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed7caf6-20fa-460c-bf48-65425dcf3952+6:18226:x1876180399710720:12345-192.168.203.49@tcp:101:mkdir.0 00010000:00010000:0.0:1789265671.869798:0:25384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265671.869829:0:25384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc80030000/0x9272d942b4a98560 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc3fc expref: -99 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265671.869925:0:25384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc80030400/0x9272d942b4a98567 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265671.869951:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc80030400/0x9272d942b4a98567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265671.869969:0:25384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc80030400/0x9272d942b4a98567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265671.870062:0:25384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789265671.870067:0:25384:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265671.870096:0:25384:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc80030400/0x9272d942b4a98567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265671.870131:0:25384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc80030000/0x9272d942b4a98560 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3fc expref: 8 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265671.870155:0:25384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc80030400/0x9272d942b4a98567 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3fc expref: 7 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265671.870189:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcb83b85800) 00010000:00010000:0.0:1789265671.870192:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265671.870196:0:25384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc80030400, rc 0) 00000100:00100000:0.0:1789265671.870289:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed7caf6-20fa-460c-bf48-65425dcf3952+7:18226:x1876180399710720:12345-192.168.203.49@tcp:101:mkdir.0 Request processed in 521us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265671.870297:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 22 00010000:00010000:0.0:1789265672.065613:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789265673.091088:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265673.731108:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265673.731128:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417642624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265673.731187:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265673.731303:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417642624 00000100:00100000:1.0:1789265673.731310:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417642624 00000100:00100000:1.0:1789265673.731358:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789265673.731367:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417642624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789265673.731392:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789265673.731446:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417642624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265673.731459:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789265673.731477:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265673.731484:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417642752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265673.731508:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789265673.731530:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265673.731543:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417642752 00000100:00100000:1.0:1789265673.731546:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417642752 00000100:00100000:1.0:1789265673.731567:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789265673.731572:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417642752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265673.731593:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789265673.731628:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417642752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265673.731634:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789265673.731682:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417642752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265673.731709:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417642624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265673.732397:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417642880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265673.732437:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265673.732536:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417642880 00000100:00100000:3.0:1789265673.732540:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417642880 00000100:00100000:3.0:1789265673.732572:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789265673.732578:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417642880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789265673.732598:0:22765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789265673.732632:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417642880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265673.732638:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789265673.733114:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417642880:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789265674.113292:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789265674.755379:0:24260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fed7caf6-20fa-460c-bf48-65425dcf3952 00000001:00100000:1.0:1789265674.755391:0:24260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c0c77789-04ce-4c79-87b2-012b259e18c5 00000001:00100000:2.0:1789265674.756097:0:25080:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fed7caf6-20fa-460c-bf48-65425dcf3952 00000001:00100000:2.0:1789265674.756105:0:25080:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c0c77789-04ce-4c79-87b2-012b259e18c5 00000001:00100000:0.0:1789265674.756251:0:22739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fed7caf6-20fa-460c-bf48-65425dcf3952 00000001:00100000:0.0:1789265674.756260:0:22739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c0c77789-04ce-4c79-87b2-012b259e18c5 00000001:00100000:0.0:1789265674.757752:0:23492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fed7caf6-20fa-460c-bf48-65425dcf3952 00000001:00100000:0.0:1789265674.757762:0:23492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c0c77789-04ce-4c79-87b2-012b259e18c5 00010000:00010000:3.0:1789265675.141369:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265675.780359:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789265675.780383:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417643008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789265675.780451:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265675.781556:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417643008 00000100:00100000:0.0:1789265675.781565:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417643008 00000100:00100000:0.0:1789265675.781635:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265675.781646:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417643008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789265675.781683:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1789265675.781736:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417643008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265675.781743:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789265675.781797:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417643008:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789265675.781850:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265675.782093:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417643520:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.782128:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.782150:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417644032:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.782189:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.782204:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417644544:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.782224:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.782239:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789265675.782245:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417643136:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.782270:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.782291:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417643648:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.782313:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.782330:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417644160:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.782350:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.782373:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417643392:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.782399:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.782415:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417643904:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.782434:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.782449:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417644416:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.782468:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.782480:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789265675.782485:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417643264:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.782506:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.782524:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417643776:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.782544:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.782560:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417644288:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.782578:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265675.782599:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417643648 00000100:00100000:1.0:1789265675.782612:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417643648 00000100:00100000:1.0:1789265675.782640:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417643264 00000100:00100000:1.0:1789265675.782643:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417643264 00000100:00100000:1.0:1789265675.782673:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789265675.782680:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc837e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417643648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.782718:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc837e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417643648:12345-0@lo:400:kworker.0 Request processed in 38us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265675.782725:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789265675.782736:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789265675.782742:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417643264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.782771:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417643264:12345-0@lo:400:kworker.0 Request processed in 29us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265675.782776:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789265675.782792:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417643520 00000100:00100000:1.0:1789265675.782795:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417643520 00000100:00100000:1.0:1789265675.782812:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417644032 00000100:00100000:1.0:1789265675.782814:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417644032 00000100:00100000:1.0:1789265675.782824:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417644544 00000100:00100000:1.0:1789265675.782826:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417644544 00000100:00100000:1.0:1789265675.782842:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417644160 00000100:00100000:1.0:1789265675.782844:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417644160 00000100:00100000:1.0:1789265675.782853:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417644416 00000100:00100000:1.0:1789265675.782855:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417644416 00000100:00100000:1.0:1789265675.782864:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417644288 00000100:00100000:1.0:1789265675.782867:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417644288 00000100:00100000:1.0:1789265675.782878:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789265675.782883:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417643520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.782912:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876180417643520:12345-0@lo:400:kworker.0 Request processed in 28us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265675.782917:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789265675.782938:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789265675.782944:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417644032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.782970:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876180417644032:12345-0@lo:400:kworker.0 Request processed in 27us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265675.782975:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789265675.782986:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789265675.782991:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417644544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.783046:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876180417644544:12345-0@lo:400:kworker.0 Request processed in 54us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265675.783051:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789265675.783062:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789265675.783068:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417644160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.783093:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876180417644160:12345-0@lo:400:kworker.0 Request processed in 26us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265675.783099:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789265675.783110:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789265675.783116:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417644416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.783140:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417644416:12345-0@lo:400:kworker.0 Request processed in 25us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265675.783147:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789265675.783157:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789265675.783162:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417644288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.783187:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417644288:12345-0@lo:400:kworker.0 Request processed in 25us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265675.783192:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789265675.783220:0:25154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417643392 00000100:00100000:1.0:1789265675.783223:0:25154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417643392 00000100:00100000:1.0:1789265675.783245:0:25154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417643904 00000100:00100000:1.0:1789265675.783248:0:25154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417643904 00000100:00100000:1.0:1789265675.783271:0:25154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417643776 00000100:00100000:1.0:1789265675.783274:0:25154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417643776 00000100:00100000:1.0:1789265675.783288:0:25154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265675.783294:0:25154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417643392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.783324:0:25154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417643392:12345-0@lo:400:kworker.0 Request processed in 30us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265675.783329:0:25154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789265675.783340:0:25154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265675.783346:0:25154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417643904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.783370:0:25154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417643904:12345-0@lo:400:kworker.0 Request processed in 25us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265675.783376:0:25154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789265675.783386:0:25154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265675.783391:0:25154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417643776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.783416:0:25154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417643776:12345-0@lo:400:kworker.0 Request processed in 26us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265675.783422:0:25154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789265675.783454:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417643264:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.783464:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417643776:0@lo:400:kworker.0 00010000:00080000:1.0:1789265675.783475:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23df80 x1876180417644288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265675.783485:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417644288:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.783505:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417643392:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.783514:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417643904:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.783523:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417644416:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.783557:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417643648:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.783566:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876180417644160:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.783574:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876180417643520:0@lo:400:kworker.0 00000100:00100000:1.0:1789265675.783583:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876180417644032:0@lo:400:kworker.0 00010000:00080000:1.0:1789265675.783593:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccbd23ca80 x1876180417644544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789265675.783602:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876180417644544:0@lo:400:kworker.0 00000100:00080000:2.0:1789265675.783846:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265675.783850:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265675.783852:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789265675.783854:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789265675.784248:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417643136 00000100:00100000:0.0:1789265675.784253:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417643136 00000100:00100000:0.0:1789265675.784283:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789265675.784290:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc9b089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+24:3641:x1876180417643136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265675.784336:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc9b089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+24:3641:x1876180417643136:12345-0@lo:400:kworker.0 Request processed in 46us (2065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265675.784343:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789265675.784381:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417644672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265675.784407:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265675.784436:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417644672 00000100:00100000:0.0:1789265675.784440:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417644672 00000100:00100000:0.0:1789265675.784463:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265675.784470:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417644672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789265675.784489:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789265675.784520:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417644672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265675.784525:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789265675.784556:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417644672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789265675.784572:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265675.784578:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417644800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265675.784599:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265675.784619:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417644800 00000100:00100000:0.0:1789265675.784622:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417644800 00000100:00100000:0.0:1789265675.784642:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265675.784647:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417644800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265675.784668:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1789265675.784696:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417644800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265675.784702:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789265675.784735:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417644800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265675.785315:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417643136:0@lo:400:kworker.0 00000001:02000400:1.0:1789265675.801786:0:25638:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789265676.163944:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265676.481952:0:22793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789265677.132053:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265677.132091:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265677.132113:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265677.132142:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265677.132170:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265677.132192:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265677.132214:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265677.132237:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265677.132266:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265677.132301:0:25154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399711232 00000100:00100000:1.0:1789265677.132323:0:25154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399711232 00000100:00100000:1.0:1789265677.132394:0:25154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399711744 00000100:00100000:1.0:1789265677.132398:0:25154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399711744 00000100:00100000:1.0:1789265677.132414:0:25154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399711360 00000100:00100000:1.0:1789265677.132416:0:25154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399711360 00000100:00100000:1.0:1789265677.132430:0:25154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399711872 00000100:00100000:1.0:1789265677.132433:0:25154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399711872 00000100:00100000:1.0:1789265677.132450:0:25154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:1.0:1789265677.132462:0:25154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0c77789-04ce-4c79-87b2-012b259e18c5+5:2394:x1876180399711232:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265677.132555:0:25154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0c77789-04ce-4c79-87b2-012b259e18c5+5:2394:x1876180399711232:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 94us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265677.132563:0:25154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:1.0:1789265677.132583:0:25154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00100000:1.0:1789265677.132590:0:25154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2394:x1876180399711744:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265677.132615:0:25154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2394:x1876180399711744:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 26us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265677.132621:0:25154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00100000:1.0:1789265677.132633:0:25154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00100000:1.0:1789265677.132639:0:25154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0c77789-04ce-4c79-87b2-012b259e18c5+5:2394:x1876180399711360:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265677.132674:0:25154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0c77789-04ce-4c79-87b2-012b259e18c5+5:2394:x1876180399711360:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 35us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265677.132680:0:25154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00100000:1.0:1789265677.132691:0:25154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:1.0:1789265677.132697:0:25154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2394:x1876180399711872:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265677.132719:0:25154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2394:x1876180399711872:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265677.132734:0:25154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:1.0:1789265677.132757:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399710976 00000100:00100000:1.0:1789265677.132761:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399710976 00000100:00100000:1.0:1789265677.132783:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399711488 00000100:00100000:1.0:1789265677.132786:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399711488 00000100:00100000:1.0:1789265677.132797:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399711104 00000100:00100000:1.0:1789265677.132799:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399711104 00000100:00100000:1.0:1789265677.132810:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399711616 00000100:00100000:1.0:1789265677.132812:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399711616 00000100:00100000:1.0:1789265677.132825:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 56 00000100:00100000:1.0:1789265677.132830:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+6:2394:x1876180399710976:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265677.132860:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+6:2394:x1876180399710976:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 29us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265677.132865:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 56 00000100:00100000:1.0:1789265677.132877:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 57 00000100:00100000:1.0:1789265677.132883:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+6:2394:x1876180399711488:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265677.132906:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+6:2394:x1876180399711488:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 24us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265677.132913:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 57 00000100:00100000:1.0:1789265677.132925:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 58 00000100:00100000:1.0:1789265677.132930:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaa292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+5:2394:x1876180399711104:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265677.132952:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaa292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+5:2394:x1876180399711104:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 22us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265677.132959:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 58 00000100:00100000:1.0:1789265677.132970:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00100000:1.0:1789265677.132984:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2394:x1876180399711616:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265677.133010:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2394:x1876180399711616:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265677.133016:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00100000:3.0:1789265677.134300:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399710848 00000100:00100000:3.0:1789265677.134312:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399710848 00000100:00100000:3.0:1789265677.134374:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 147 00000100:00100000:3.0:1789265677.134395:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:2394:x1876180399710848:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265677.134439:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:2394:x1876180399710848:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 47us (2268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265677.134446:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 147 00000100:00080000:3.0:1789265677.137984:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789265677.137998:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789265677.138003:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789265677.138007:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789265677.185306:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265678.210812:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789265678.850289:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417645056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265678.850359:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265678.850415:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417645056 00000100:00100000:1.0:1789265678.850422:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417645056 00000100:00100000:1.0:1789265678.850463:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789265678.850472:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417645056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789265678.850502:0:23784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789265678.850541:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417645056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265678.850549:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789265678.850594:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417645056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789265678.850743:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265678.850753:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417644928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265678.850782:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265678.850811:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417644928 00000100:00100000:2.0:1789265678.850815:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417644928 00000100:00100000:2.0:1789265678.850840:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789265678.850847:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417644928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789265678.850864:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789265678.850910:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417644928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265678.850917:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789265678.850946:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417644928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789265678.851160:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789265678.851169:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82869500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417645184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265678.851208:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265678.851313:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417645184 00000100:00100000:2.0:1789265678.851318:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417645184 00000100:00100000:2.0:1789265678.851364:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789265678.851370:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417645184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789265678.851388:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789265678.851423:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417645184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265678.851429:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789265678.851460:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82869500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417645184:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789265678.851754:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789265679.234477:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789265679.641933:0:23512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789265680.258388:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789265680.261594:0:25785:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7a5e61c0 20000000:00000080:0.0:1789265680.261612:0:25785:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fccb7ba2400 uarg=0000000000000000 20000000:01000000:0.0:1789265680.264353:0:25785:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789265680.264362:0:25785:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789265680.264367:0:25785:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789265680.272566:0:25786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1789265680.276402:0:25785:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789265680.288813:0:25785:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789265680.289392:0:25785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fccb71c7000/0x9272d942b4a9856e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265680.289413:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb83da5400/0x9272d942b4a981cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a981c4 expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265680.289441:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb83f52200/0x9272d942b4a981d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a981d2 expref: 23 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265680.289449:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb83da5000/0x9272d942b4a98218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a98211 expref: 23 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265680.289456:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a982b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a982ab expref: 23 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265680.289465:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcb83f52a00/0x9272d942b4a984fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc35b expref: 12 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265680.289472:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9853d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3cb expref: 12 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265680.289480:0:25785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fccb71c7000/0x9272d942b4a9856e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265680.289556:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9853d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3cb expref: 12 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265680.289571:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9853d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3cb expref: 12 pid: 22754 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265680.289587:0:25785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1876180417645312:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265680.289826:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb83f52a00/0x9272d942b4a984fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc35b expref: 12 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265680.289836:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb83f52a00/0x9272d942b4a984fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc35b expref: 12 pid: 22753 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265680.289852:0:25785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1876180417645440:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265680.289888:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a982b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a982ab expref: 23 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265680.289907:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a982b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a982ab expref: 23 pid: 22752 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265680.289916:0:25785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1876180417645568:0@lo:104: 00000100:00100000:1.0:1789265680.289982:0:25785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265680.290047:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb83da5000/0x9272d942b4a98218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a98211 expref: 23 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265680.290056:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb83da5000/0x9272d942b4a98218 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a98211 expref: 23 pid: 22752 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265680.290064:0:25785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1876180417645696:0@lo:104: 00000100:00100000:1.0:1789265680.290087:0:25785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265680.290117:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb83f52200/0x9272d942b4a981d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a981d2 expref: 23 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265680.290124:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb83f52200/0x9272d942b4a981d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a981d2 expref: 23 pid: 22754 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265680.290147:0:25785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1876180417645824:0@lo:104: 00000100:00100000:1.0:1789265680.290178:0:25785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789265680.290205:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fcb83da5400/0x9272d942b4a981cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9272d942b4a981c4 expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265680.290336:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417645568 00000100:00100000:0.0:1789265680.290344:0:24290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417645568 00000100:00100000:0.0:1789265680.290382:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417645696 00000100:00100000:0.0:1789265680.290385:0:24290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417645696 00000100:00100000:0.0:1789265680.290395:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417645824 00000100:00100000:0.0:1789265680.290397:0:24290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417645824 00000100:00100000:0.0:1789265680.290410:0:24290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265680.290418:0:24290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:82fe313a-a4f8-4781-be1f-82c20160e337+5:25785:x1876180417645568:12345-0@lo:104: 00010000:00010000:0.0:1789265680.290430:0:24290:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a982ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a982b2 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290478:0:24290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789265680.290485:0:24290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:82fe313a-a4f8-4781-be1f-82c20160e337+5:25785:x1876180417645568:12345-0@lo:104: Request processed in 67us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265680.290492:0:24290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789265680.290507:0:24290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265680.290514:0:24290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:82fe313a-a4f8-4781-be1f-82c20160e337+4:25785:x1876180417645696:12345-0@lo:104: 00010000:00010000:0.0:1789265680.290521:0:24290:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff400/0x9272d942b4a98211 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a98218 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290560:0:24290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789265680.290566:0:24290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:82fe313a-a4f8-4781-be1f-82c20160e337+4:25785:x1876180417645696:12345-0@lo:104: Request processed in 53us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265680.290572:0:24290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265680.290585:0:24290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789265680.290591:0:24290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:82fe313a-a4f8-4781-be1f-82c20160e337+3:25785:x1876180417645824:12345-0@lo:104: 00010000:00010000:0.0:1789265680.290598:0:24290:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a981d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a981d9 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290631:0:24290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789265680.290636:0:24290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:82fe313a-a4f8-4781-be1f-82c20160e337+3:25785:x1876180417645824:12345-0@lo:104: Request processed in 47us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265680.290642:0:24290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789265680.290659:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789265680.290665:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a982ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a982b2 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290682:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2e000 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:0.0:1789265680.290687:0:22747:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a982ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a982b2 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290695:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a982ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a982b2 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265680.290702:0:22747:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a982ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a982b2 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265680.290707:0:22747:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265680.290742:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a982ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a982b2 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290749:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265680.290768:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a982ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a982b2 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290775:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2e000/0x9272d942b4a982ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a982b2 expref: -99 pid: 25079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290788:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789265680.290791:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff400/0x9272d942b4a98211 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a98218 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290797:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccbd2ff400 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:0.0:1789265680.290799:0:22747:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff400/0x9272d942b4a98211 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a98218 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290806:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff400/0x9272d942b4a98211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a98218 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265680.290811:0:22747:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff400/0x9272d942b4a98211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a98218 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265680.290816:0:22747:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265680.290828:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff400/0x9272d942b4a98211 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98218 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290833:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265680.290839:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff400/0x9272d942b4a98211 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98218 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290856:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fccbd2ff400/0x9272d942b4a98211 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a98218 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290865:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789265680.290868:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a981d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a981d9 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290873:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb83da5e00 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:0.0:1789265680.290876:0:22747:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a981d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a981d9 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290882:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a981d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a981d9 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789265680.290888:0:22747:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a981d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a981d9 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265680.290893:0:22747:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789265680.290907:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a981d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a981d9 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290912:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789265680.290927:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a981d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a981d9 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290933:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb83da5e00/0x9272d942b4a981d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a981d9 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.290943:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265680.290951:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265680.290953:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265680.290973:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82fe313a-a4f8-4781-be1f-82c20160e337:3643:1876180417646080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265680.291043:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265680.291064:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789265680.291071:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82fe313a-a4f8-4781-be1f-82c20160e337:3643:1876180417646208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265680.291092:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265680.291118:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417646336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789265680.291139:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265680.291169:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417646080 00000100:00100000:0.0:1789265680.291174:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417646080 00010000:00010000:0.0:1789265680.291192:0:22746:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a982b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a982ab expref: 24 pid: 22752 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265680.291207:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417646208 00000100:00100000:0.0:1789265680.291209:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417646208 00000100:00100000:3.0:1789265680.291734:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417646336 00000100:00100000:3.0:1789265680.291739:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417646336 00010000:00010000:3.0:1789265680.291758:0:22744:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb83f52200/0x9272d942b4a981d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a981d2 expref: 26 pid: 22754 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265680.291777:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265680.291784:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82fe313a-a4f8-4781-be1f-82c20160e337+26:3643:x1876180417646080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265680.291794:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265680.291799:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a982b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a982ab expref: 26 pid: 22752 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265680.291897:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fcb83da5400/0x9272d942b4a981cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9272d942b4a981c4 expref: 26 pid: 22753 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265680.291909:0:25785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83c9ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1876180417645952:0@lo:104: 00000100:00100000:1.0:1789265680.291944:0:25785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265680.291973:0:25785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccacdb6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265680.291993:0:25785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1876180417645568:0@lo:104: 00000100:00100000:1.0:1789265680.292002:0:25785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1876180417645696:0@lo:104: 00000100:00100000:1.0:1789265680.292009:0:25785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1876180417645824:0@lo:104: 00000100:00100000:1.0:1789265680.292059:0:22745:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789265680.292067:0:22745:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789265680.292843:0:22746:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb83da5000/0x9272d942b4a98218 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a98211 expref: 25 pid: 22752 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265680.292871:0:22746:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789265680.292881:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789265680.292901:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82fe313a-a4f8-4781-be1f-82c20160e337+26:3641:x1876180417646336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789265680.292913:0:22746:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265680.292919:0:22746:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb83f52200/0x9272d942b4a981d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a981d2 expref: 26 pid: 22754 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265680.293480:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417645952 00000100:00100000:2.0:1789265680.293487:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417645952 00000100:00100000:2.0:1789265680.293531:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265680.293540:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82fe313a-a4f8-4781-be1f-82c20160e337+3:25785:x1876180417645952:12345-0@lo:104: 00010000:00010000:2.0:1789265680.293552:0:22742:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a981c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a981cb expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265680.293634:0:22742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789265680.293640:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82fe313a-a4f8-4781-be1f-82c20160e337+3:25785:x1876180417645952:12345-0@lo:104: Request processed in 102us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265680.293646:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789265680.294125:0:22748:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789265680.294145:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a981c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9272d942b4a981cb expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265680.294340:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcb84a2f400 already unused, calling callback (ffffffffc1191c20) 10000000:00010000:2.0:1789265680.294346:0:22748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a981c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9272d942b4a981cb expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265680.294355:0:22748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a981c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9272d942b4a981cb expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789265680.294362:0:22748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a981c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9272d942b4a981cb expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265680.294368:0:22748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789265680.294408:0:22748:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a981c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a981cb expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265680.294416:0:22748:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789265680.294437:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a981c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a981cb expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265680.294444:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.149@tcp lock: ffff9fcb84a2f400/0x9272d942b4a981c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9272d942b4a981cb expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265680.294465:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265680.294467:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789265680.294468:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789265680.294485:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82869500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82fe313a-a4f8-4781-be1f-82c20160e337:3642:1876180417646464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789265680.294531:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265680.294745:0:25785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83c9ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1876180417645952:0@lo:104: 00010000:00010000:3.0:1789265680.295678:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a982b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a982ab expref: 26 pid: 22752 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265680.295704:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccbd2fe000/0x9272d942b4a982b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a982ab expref: 26 pid: 22752 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265680.295721:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265680.295790:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82fe313a-a4f8-4781-be1f-82c20160e337+25:3643:x1876180417646080:12345-0@lo:103:ldlm_bl.0 Request processed in 4006us (4745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265680.295815:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789265680.295847:0:22744:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789265680.295855:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417646464 00000100:00100000:3.0:1789265680.295861:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417646464 00010000:00010000:3.0:1789265680.295882:0:22744:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb83da5400/0x9272d942b4a981cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a981c4 expref: 25 pid: 22753 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265680.296162:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82fe313a-a4f8-4781-be1f-82c20160e337:3643:1876180417646080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265680.298486:0:22744:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789265680.298516:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265680.298533:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82fe313a-a4f8-4781-be1f-82c20160e337+25:3643:x1876180417646208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265680.298552:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265680.298562:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb83da5000/0x9272d942b4a98218 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a98211 expref: 25 pid: 22752 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265680.298577:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb83da5000/0x9272d942b4a98218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a98211 expref: 25 pid: 22752 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265680.298608:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83da5000/0x9272d942b4a98218 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a98211 expref: 25 pid: 22752 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265680.298632:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265680.299962:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82fe313a-a4f8-4781-be1f-82c20160e337+24:3643:x1876180417646208:12345-0@lo:103:ldlm_bl.0 Request processed in 1430us (8864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265680.299981:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789265680.300013:0:22744:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789265680.300038:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789265680.300048:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82fe313a-a4f8-4781-be1f-82c20160e337+23:3642:x1876180417646464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789265680.300061:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265680.300079:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb83da5400/0x9272d942b4a981cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9272d942b4a981c4 expref: 23 pid: 22753 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265680.300092:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb83da5400/0x9272d942b4a981cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a981c4 expref: 23 pid: 22753 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265680.300108:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83da5400/0x9272d942b4a981cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a981c4 expref: 23 pid: 22753 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265680.300120:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265680.300192:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82fe313a-a4f8-4781-be1f-82c20160e337+22:3642:x1876180417646464:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (5660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265680.300198:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789265680.301377:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82fe313a-a4f8-4781-be1f-82c20160e337:3643:1876180417646208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789265680.301580:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82869500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82fe313a-a4f8-4781-be1f-82c20160e337:3642:1876180417646464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789265680.307514:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789265680.309403:0:22746:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb83f52200/0x9272d942b4a981d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9272d942b4a981d2 expref: 21 pid: 22754 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.309449:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83f52200/0x9272d942b4a981d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9272d942b4a981d2 expref: 21 pid: 22754 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.309466:0:22746:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265680.309561:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82fe313a-a4f8-4781-be1f-82c20160e337+20:3641:x1876180417646336:12345-0@lo:103:ldlm_bl.0 Request processed in 16672us (18419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265680.309571:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789265680.311061:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417646336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789265680.319872:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265680.319971:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265680.320111:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399712000 00000100:00100000:0.0:1789265680.320121:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399712000 00010000:00010000:0.0:1789265680.320178:0:22745:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9853d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3cb expref: 13 pid: 22754 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265680.320210:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399712128 00000100:00100000:0.0:1789265680.320213:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399712128 00010000:00010000:0.0:1789265680.320237:0:22745:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fcb83f52a00/0x9272d942b4a984fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc35b expref: 14 pid: 22753 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265680.320259:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:0.0:1789265680.320269:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaea77050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+14:2396:x1876180399712000:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265680.320283:0:22745:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265680.320289:0:22745:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9853d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3cb expref: 14 pid: 22754 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.320303:0:22745:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9853d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3cb expref: 14 pid: 22754 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.320322:0:22745:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265680.320368:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaea77050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+14:2396:x1876180399712000:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 101us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265680.320389:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:0.0:1789265680.320433:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00100000:0.0:1789265680.320439:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:2395:x1876180399712128:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265680.320447:0:22745:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265680.320451:0:22745:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fcb83f52a00/0x9272d942b4a984fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc35b expref: 13 pid: 22753 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.320459:0:22745:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fcb83f52a00/0x9272d942b4a984fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc35b expref: 13 pid: 22753 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.320470:0:22745:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fccb71c7000/0x9272d942b4a9856e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.320477:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccb71c7000/0x9272d942b4a9856e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.320492:0:22745:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fccb71c7000/0x9272d942b4a9856e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.320499:0:22745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fccb71c7000/0x9272d942b4a9856e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.320505:0:22745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fccb71c7000/0x9272d942b4a9856e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.320510:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fccb71c7000/0x9272d942b4a9856e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.320515:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c7000 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:0.0:1789265680.320527:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fccb71c7000/0x9272d942b4a9856e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.320535:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fccb71c7000/0x9272d942b4a9856e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.320543:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fccb71c7000/0x9272d942b4a9856e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265680.320552:0:22745:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265680.320573:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:2395:x1876180399712128:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 134us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265680.320579:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 14 00010000:00010000:2.0:1789265680.328657:0:25785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcc81490000/0x9272d942b4a9853d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3cb expref: 12 pid: 22754 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265680.328680:0:25785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1876180417645312:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265680.328696:0:25785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fcb83f52a00/0x9272d942b4a984fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc35b expref: 11 pid: 22753 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265680.328706:0:25785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbd23d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1876180417645440:192.168.203.49@tcp:104: 00010000:00010000:2.0:1789265680.328743:0:25785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fccb71c7000/0x9272d942b4a9856e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265680.328753:0:25785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fccb71c7000/0x9272d942b4a9856e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265680.328759:0:25785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fccb71c7000/0x9272d942b4a9856e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265680.328766:0:25785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fccb71c7000/0x9272d942b4a9856e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265680.897270:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789265680.897293:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417646592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789265680.897365:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265680.897426:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417646592 00000100:00100000:0.0:1789265680.897443:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417646592 00000100:00100000:0.0:1789265680.897499:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789265680.897509:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417646592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789265680.897546:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1789265680.897592:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417646592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265680.897599:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789265680.897631:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789265680.897670:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417646592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789265680.898084:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417646720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265680.898116:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265680.898145:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417646720 00000100:00100000:3.0:1789265680.898149:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417646720 00000100:00100000:3.0:1789265680.898182:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789265680.898188:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417646720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265680.898199:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789265680.898227:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417646720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265680.898233:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1789265680.898248:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789265680.898268:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417646720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789265680.898769:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417646848:0@lo:400:kworker.0 00000100:00100000:3.0:1789265680.898820:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265680.898844:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417647360:0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.898985:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417647104:0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.899018:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265680.899060:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417647616:0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.899106:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265680.899125:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417648128:0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.899146:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265680.899165:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789265680.899170:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417647232:0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.899191:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265680.899209:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417647744:0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.899237:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265680.899262:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417646976:0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.899284:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265680.899301:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417647488:0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.899320:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265680.899336:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417648000:0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.899356:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265680.899379:0:25154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417647104 00000100:00100000:1.0:1789265680.899383:0:25154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417647104 00000100:00100000:0.0:1789265680.899562:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417646848 00000100:00100000:0.0:1789265680.899566:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417646848 00000100:00100000:0.0:1789265680.899607:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789265680.899614:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+20:3641:x1876180417646848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789265680.899662:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+20:3641:x1876180417646848:12345-0@lo:400:kworker.0 Request processed in 49us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265680.899669:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789265680.899778:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417647616 00000100:00100000:0.0:1789265680.899781:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417647616 00000100:00100000:0.0:1789265680.899798:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417648128 00000100:00100000:0.0:1789265680.899800:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417648128 00000100:00100000:0.0:1789265680.899812:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417647232 00000100:00100000:0.0:1789265680.899814:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417647232 00000100:00100000:0.0:1789265680.899822:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417647744 00000100:00100000:0.0:1789265680.899824:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417647744 00000100:00100000:0.0:1789265680.899834:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417648000 00000100:00100000:0.0:1789265680.899836:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417648000 00000100:00100000:0.0:1789265680.899848:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789265680.899853:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417647616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.899956:0:25154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417647488 00000100:00100000:1.0:1789265680.899960:0:25154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417647488 00000100:00100000:1.0:1789265680.899982:0:25154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789265680.899988:0:25154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417647104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265680.900202:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789265680.900212:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417648256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265680.901734:0:25154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417647104:12345-0@lo:400:kworker.0 Request processed in 1739us (2709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265680.901752:0:25154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789265680.901779:0:25154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265680.901788:0:25154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417647488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.901836:0:25154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417647488:12345-0@lo:400:kworker.0 Request processed in 51us (2516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265680.901842:0:25154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789265680.901865:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417646976 00000100:00100000:1.0:1789265680.901871:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417646976 00000100:00100000:1.0:1789265680.901902:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789265680.901909:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417646976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.901962:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417646976:12345-0@lo:400:kworker.0 Request processed in 53us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265680.901974:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1789265680.901997:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789265680.902003:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789265680.902007:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265680.902059:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417646976:0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.902074:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417647488:0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.902123:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789265680.902131:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417648128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.902166:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876180417648128:12345-0@lo:400:kworker.0 Request processed in 37us (3019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265680.902172:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789265680.902187:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265680.902194:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417647232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.902222:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876180417647232:12345-0@lo:400:kworker.0 Request processed in 29us (3031us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265680.902228:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265680.902239:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789265680.902245:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417647744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.902272:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876180417647744:12345-0@lo:400:kworker.0 Request processed in 27us (3034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265680.902278:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789265680.902289:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789265680.902295:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417648000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.902326:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876180417648000:12345-0@lo:400:kworker.0 Request processed in 31us (2969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265680.902337:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789265680.902365:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876180417648000:0@lo:400:kworker.0 00000100:00100000:3.0:1789265680.904255:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265680.904304:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417647872:0@lo:400:kworker.0 00000100:00100000:3.0:1789265680.904352:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265680.904395:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82fe313a-a4f8-4781-be1f-82c20160e337:3641:1876180417646848:0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.906701:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417647360 00000100:00100000:1.0:1789265680.906716:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417647360 00000100:00100000:1.0:1789265680.907045:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789265680.907057:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417647360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.907142:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417647360:12345-0@lo:400:kworker.0 Request processed in 88us (2892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265680.907150:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789265680.907199:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417647872 00000100:00100000:1.0:1789265680.907204:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417647872 00000100:00100000:1.0:1789265680.907239:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789265680.907245:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417647872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265680.907279:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876180417647872:12345-0@lo:400:kworker.0 Request processed in 34us (2925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265680.907286:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1789265680.907305:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789265680.907616:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417647360:0@lo:400:kworker.0 00010000:00080000:3.0:1789265680.907646:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83bb8700 x1876180417647872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789265680.907658:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876180417647872:0@lo:400:kworker.0 00000100:00100000:0.0:1789265680.909012:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876180417647616:12345-0@lo:400:kworker.0 Request processed in 9151us (9898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265680.909038:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789265680.909667:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265680.909728:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876180417647232:0@lo:400:kworker.0 00000100:00100000:2.0:1789265680.909740:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876180417647744:0@lo:400:kworker.0 00000100:00100000:2.0:1789265680.909750:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417647104:0@lo:400:kworker.0 00000100:00100000:2.0:1789265680.909776:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876180417647616:0@lo:400:kworker.0 00010000:00080000:2.0:1789265680.909789:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83bba300 x1876180417648128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265680.909799:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876180417648128:0@lo:400:kworker.0 00000100:00100000:3.0:1789265680.910005:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417648256 00000100:00100000:3.0:1789265680.910012:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417648256 00000100:00100000:3.0:1789265680.910125:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789265680.910136:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417648256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265680.910166:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789265680.910221:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417648256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265680.910227:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789265680.910293:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417648256:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789265681.281225:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789265681.601156:0:22757:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265681.601164:0:22757:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fcb82c56000 from 13 10000000:01000000:0.0:1789265681.601177:0:22757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265681.601236:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a98575 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265681.601248:0:22757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a98575 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265681.601259:0:22757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a98575 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265681.601305:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417648384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265681.601372:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265681.601471:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265681.612892:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417648384 00000100:00100000:1.0:1789265681.612907:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417648384 00000100:00100000:1.0:1789265681.612979:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789265681.612990:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+20:22757:x1876180417648384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265681.613005:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265681.613052:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccb71c6400/0x9272d942b4a9857c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a98575 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265681.613089:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccb71c6400/0x9272d942b4a9857c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a98575 expref: 21 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265681.613114:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccb71c6400/0x9272d942b4a9857c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a98575 expref: 21 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265681.613122:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb71c6400, rc 0) 00000100:00100000:1.0:1789265681.613280:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+21:22757:x1876180417648384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 292us (11907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265681.613286:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789265681.620509:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417648384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265681.620537:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a98575 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9857c expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265681.620549:0:22757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a98575 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9857c expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265681.620665:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417648512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265681.620723:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265681.620769:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb822b9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265681.620919:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417648512 00000100:00100000:0.0:1789265681.620927:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417648512 00000100:00100000:0.0:1789265681.620971:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789265681.620981:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+21:22757:x1876180417648512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265681.621130:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+21:22757:x1876180417648512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265681.621138:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789265681.621261:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417648512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265681.621288:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417648640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265681.621322:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265681.621348:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb822b9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789265681.621957:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417648640 00000100:00100000:0.0:1789265681.621964:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417648640 00000100:00100000:0.0:1789265681.622007:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789265681.622047:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+21:22757:x1876180417648640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265681.622161:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+21:22757:x1876180417648640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265681.622168:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789265681.623948:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417648640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789265681.629387:0:25800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789265681.630110:0:22757:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789265681.630136:0:22757:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789265681.630148:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a98575 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9857c expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265681.630160:0:22757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc80031e00/0x9272d942b4a98575 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9857c expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789265681.630171:0:22757:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789265681.630191:0:22757:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fcb821f0000 from 13 10000000:01000000:0.0:1789265681.630194:0:22757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789265681.630234:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc80030000/0x9272d942b4a98583 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265681.630242:0:22757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc80030000/0x9272d942b4a98583 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265681.630254:0:22757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc80030000/0x9272d942b4a98583 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265681.630278:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8495f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417648768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789265681.630344:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265681.630395:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccada13e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789265681.631755:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417648768 00000100:00100000:1.0:1789265681.631764:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417648768 00000100:00100000:1.0:1789265681.631818:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789265681.631826:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+21:22757:x1876180417648768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265681.631839:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265681.631853:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccb71c6200/0x9272d942b4a9858a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a98583 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265681.631886:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccb71c6200/0x9272d942b4a9858a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a98583 expref: 22 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265681.631897:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccb71c6200/0x9272d942b4a9858a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a98583 expref: 22 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265681.631905:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb71c6200, rc 0) 00000100:00100000:1.0:1789265681.631963:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+22:22757:x1876180417648768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (1617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265681.631971:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789265681.631989:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8495f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417648768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265681.632013:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc80030000/0x9272d942b4a98583 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9858a expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265681.632034:0:22757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc80030000/0x9272d942b4a98583 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a9858a expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265681.632088:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417648896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265681.632113:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265681.632182:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb822b9240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265681.632240:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417648896 00000100:00100000:1.0:1789265681.632243:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417648896 00000100:00100000:1.0:1789265681.632273:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789265681.632278:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+22:22757:x1876180417648896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265681.632412:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+22:22757:x1876180417648896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265681.632424:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789265681.632483:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417648896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265681.632511:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417649024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265681.632590:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265681.632612:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb822b9240 going to sleep for 11 seconds 00000100:00100000:3.0:1789265681.632647:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417649024 00000100:00100000:3.0:1789265681.632653:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417649024 00000100:00100000:3.0:1789265681.632687:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789265681.632694:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+22:22757:x1876180417649024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265681.632781:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+22:22757:x1876180417649024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265681.632797:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789265681.633707:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417649024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789265681.634638:0:25801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789265681.634805:0:22757:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789265681.634826:0:22757:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265681.634838:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc80030000/0x9272d942b4a98583 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9858a expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265681.634849:0:22757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc80030000/0x9272d942b4a98583 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a9858a expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789265681.634861:0:22757:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789265681.634864:0:22757:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccb092a000 from 13 10000000:01000000:2.0:1789265681.634866:0:22757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789265681.634911:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a98591 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265681.634934:0:22757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a98591 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265681.634944:0:22757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a98591 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265681.634965:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417649152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789265681.635056:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265681.635092:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb822b9240 going to sleep for 11 seconds 00000100:00100000:3.0:1789265681.635156:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417649152 00000100:00100000:3.0:1789265681.635162:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417649152 00000100:00100000:3.0:1789265681.635208:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789265681.635218:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+22:22757:x1876180417649152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265681.635229:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265681.635242:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f53200/0x9272d942b4a98598 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a98591 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265681.635262:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f53200/0x9272d942b4a98598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a98591 expref: 23 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265681.635272:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f53200/0x9272d942b4a98598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a98591 expref: 23 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265681.635279:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f53200, rc 0) 00000100:00100000:3.0:1789265681.635320:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+23:22757:x1876180417649152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265681.635327:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789265681.635553:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417649152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789265681.635565:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a98591 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98598 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265681.635573:0:22757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a98591 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a98598 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265681.635632:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417649280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265681.635658:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265681.635684:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb822b9240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265681.635727:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417649280 00000100:00100000:0.0:1789265681.635731:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417649280 00000100:00100000:0.0:1789265681.635764:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789265681.635771:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+23:22757:x1876180417649280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789265681.635882:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+23:22757:x1876180417649280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265681.635889:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789265681.636057:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417649280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265681.636087:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417649408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265681.636127:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265681.636197:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb822b9240 going to sleep for 11 seconds 00000100:00100000:1.0:1789265681.636842:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417649408 00000100:00100000:1.0:1789265681.636848:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417649408 00000100:00100000:1.0:1789265681.636986:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789265681.636996:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+23:22757:x1876180417649408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265681.637520:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+23:22757:x1876180417649408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 526us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265681.637527:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789265681.637612:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417649408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789265681.638460:0:25802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789265681.638723:0:22757:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789265681.638742:0:22757:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789265681.638751:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a98591 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98598 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265681.638762:0:22757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcc81490200/0x9272d942b4a98591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a98598 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789265681.638773:0:22757:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789265681.638781:0:22757:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fccbc1ce800 from 13 10000000:01000000:3.0:1789265681.638784:0:22757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789265681.638817:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9859f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265681.638825:0:22757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9859f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265681.638834:0:22757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9859f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265681.638854:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417649536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789265681.638958:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265681.639001:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265681.639365:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417649536 00000100:00100000:1.0:1789265681.639371:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417649536 00000100:00100000:1.0:1789265681.639414:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789265681.639423:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+23:22757:x1876180417649536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265681.639434:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265681.639446:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccb71c7a00/0x9272d942b4a985a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9272d942b4a9859f expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265681.639467:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccb71c7a00/0x9272d942b4a985a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9272d942b4a9859f expref: 24 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265681.639477:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccb71c7a00/0x9272d942b4a985a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9272d942b4a9859f expref: 24 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265681.639486:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb71c7a00, rc 0) 00000100:00100000:1.0:1789265681.639537:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82fe313a-a4f8-4781-be1f-82c20160e337+24:22757:x1876180417649536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265681.639549:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789265681.639632:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417649536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265681.639645:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9859f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a985a6 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265681.639653:0:22757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9859f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9272d942b4a985a6 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265681.639701:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417649664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789265681.639723:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265681.639752:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789265681.639830:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417649664 00000100:00100000:1.0:1789265681.639834:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417649664 00000100:00100000:1.0:1789265681.639857:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789265681.639863:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+24:22757:x1876180417649664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789265681.639968:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82fe313a-a4f8-4781-be1f-82c20160e337+24:22757:x1876180417649664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265681.639973:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789265681.640490:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417649664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265681.640531:0:22757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417649792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789265681.640572:0:22757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265681.640596:0:22757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb822b9480 going to sleep for 11 seconds 00000100:00100000:0.0:1789265681.640610:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417649792 00000100:00100000:0.0:1789265681.640627:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417649792 00000100:00100000:0.0:1789265681.640658:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789265681.640668:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccad9f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+24:22757:x1876180417649792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789265681.640825:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccad9f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+24:22757:x1876180417649792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265681.640833:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789265681.640849:0:22757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb82869c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82fe313a-a4f8-4781-be1f-82c20160e337:22757:1876180417649792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789265681.642843:0:25803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789265681.643337:0:22757:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789265681.643364:0:22757:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789265681.643374:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9859f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a985a6 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265681.643386:0:22757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.149@tcp lock: ffff9fcb83f53a00/0x9272d942b4a9859f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9272d942b4a985a6 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265681.926383:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265681.926934:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399712256 00000100:00100000:3.0:1789265681.926948:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399712256 00000100:00100000:3.0:1789265681.927109:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 161 00000100:00100000:3.0:1789265681.927297:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+11:18076:x1876180399712256:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789265681.927320:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265681.927364:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fcb83f52a00/0x9272d942b4a985ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc403 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265681.927403:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fcb83f52a00/0x9272d942b4a985ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc403 expref: 12 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265681.927417:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fcb83f52a00/0x9272d942b4a985ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc403 expref: 12 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265681.927428:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcb83f52a00, rc 0) 00000100:00100000:3.0:1789265681.927513:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+12:18076:x1876180399712256:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 Request processed in 222us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265681.927521:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 161 00000100:00100000:0.0:1789265681.950184:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265681.950418:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399712384 00000100:00100000:2.0:1789265681.950432:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399712384 00000100:00100000:2.0:1789265681.950519:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 162 00000100:00100000:2.0:1789265681.950531:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+12:18076:x1876180399712384:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265681.950760:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+12:18076:x1876180399712384:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 Request processed in 231us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265681.950769:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 162 00000100:00100000:2.0:1789265681.958182:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265681.958326:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399712512 00000100:00100000:3.0:1789265681.958340:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399712512 00000100:00100000:3.0:1789265681.958409:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 163 00000100:00100000:3.0:1789265681.958420:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+12:18076:x1876180399712512:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789265681.958639:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+12:18076:x1876180399712512:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 Request processed in 219us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265681.958649:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 163 00000100:00100000:3.0:1789265681.978723:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265681.978864:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399712640 00000100:00100000:1.0:1789265681.978874:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399712640 00000100:00100000:1.0:1789265681.978938:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 164 00000100:00100000:1.0:1789265681.978948:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+12:18076:x1876180399712640:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789265681.978964:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265681.978996:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fccb71c7400/0x9272d942b4a985b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc40a expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265681.979119:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fccb71c7400/0x9272d942b4a985b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc40a expref: 13 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265681.979133:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fccb71c7400/0x9272d942b4a985b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc40a expref: 13 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265681.979143:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb71c7400, rc 0) 00000100:00100000:1.0:1789265681.979387:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:18076:x1876180399712640:12345-192.168.203.49@tcp:101:ll_cfg_requeue.0 Request processed in 439us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265681.979395:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 164 00000100:00100000:0.0:1789265682.001003:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265682.001118:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399712768 00000100:00100000:2.0:1789265682.001136:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399712768 00000100:00100000:2.0:1789265682.001211:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 165 00000100:00100000:2.0:1789265682.001219:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:18076:x1876180399712768:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789265682.001473:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:18076:x1876180399712768:12345-192.168.203.49@tcp:501:ll_cfg_requeue.0 Request processed in 253us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265682.001482:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 165 00000100:00100000:2.0:1789265682.015122:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265682.015698:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399712896 00000100:00100000:1.0:1789265682.015707:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399712896 00000100:00100000:1.0:1789265682.015772:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 166 00000100:00100000:1.0:1789265682.015781:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:18076:x1876180399712896:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789265682.016086:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:18076:x1876180399712896:12345-192.168.203.49@tcp:503:ll_cfg_requeue.0 Request processed in 304us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265682.016094:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 166 00000100:00100000:0.0:1789265682.277648:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265682.277735:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265682.277770:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265682.277807:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265682.277834:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265682.277852:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399713152 00000100:00100000:0.0:1789265682.277858:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265682.277864:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399713152 00000100:00100000:0.0:1789265682.277897:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265682.277919:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265682.278011:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399713408 00000100:00100000:3.0:1789265682.278016:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399713408 00000100:00100000:3.0:1789265682.278078:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399713920 00000100:00100000:3.0:1789265682.278082:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399713920 00000100:00100000:3.0:1789265682.278113:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399713536 00000100:00100000:3.0:1789265682.278116:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399713536 00000100:00100000:3.0:1789265682.278132:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:3.0:1789265682.278142:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83dabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+5:2395:x1876180399713408:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265682.278232:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83dabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+5:2395:x1876180399713408:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 91us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265682.278241:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:3.0:1789265682.278258:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:3.0:1789265682.278265:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2395:x1876180399713920:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265682.278287:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2395:x1876180399713920:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265682.278294:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:3.0:1789265682.278306:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:3.0:1789265682.278313:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+5:2395:x1876180399713536:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265682.278335:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+5:2395:x1876180399713536:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 24us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265682.278342:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:3.0:1789265682.278360:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399713024 00000100:00100000:3.0:1789265682.278363:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399713024 00000100:00100000:3.0:1789265682.278385:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 167 00000100:00100000:3.0:1789265682.278390:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:2395:x1876180399713024:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265682.278413:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:2395:x1876180399713024:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 22us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265682.278419:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 167 00000100:00100000:0.0:1789265682.278627:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265682.278681:0:24771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399714048 00000100:00100000:3.0:1789265682.278686:0:24771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399714048 00000100:00100000:3.0:1789265682.278710:0:24771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 22 00000100:00100000:3.0:1789265682.278716:0:24771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2395:x1876180399714048:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265682.278751:0:24771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2395:x1876180399714048:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 35us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265682.278759:0:24771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 22 00000100:00100000:3.0:1789265682.278779:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399713664 00000100:00100000:3.0:1789265682.278782:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399713664 00000100:00100000:3.0:1789265682.278803:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399713280 00000100:00100000:3.0:1789265682.278806:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399713280 00000100:00100000:2.0:1789265682.278812:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399713792 00000100:00100000:2.0:1789265682.278817:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399713792 00000100:00100000:3.0:1789265682.278848:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 66 00000100:00100000:3.0:1789265682.278863:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8495f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+6:2395:x1876180399713152:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265682.278890:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8495f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+6:2395:x1876180399713152:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 29us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265682.279015:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 67 00000100:00100000:2.0:1789265682.279039:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed7caf6-20fa-460c-bf48-65425dcf3952+6:2395:x1876180399713664:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265682.279071:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed7caf6-20fa-460c-bf48-65425dcf3952+6:2395:x1876180399713664:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 48us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265682.279077:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 67 00000100:00100000:2.0:1789265682.279091:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 68 00000100:00100000:2.0:1789265682.279097:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+5:2395:x1876180399713280:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265682.279121:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+5:2395:x1876180399713280:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 25us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265682.279133:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 68 00000100:00100000:2.0:1789265682.279146:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 69 00000100:00100000:2.0:1789265682.279152:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2395:x1876180399713792:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265682.279225:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2395:x1876180399713792:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 72us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265682.279237:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 69 00000100:00080000:2.0:1789265682.279266:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789265682.279277:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789265682.279279:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789265682.279281:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265682.286211:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 66 00000100:00100000:3.0:1789265682.301070:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265682.301182:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399714176 00000100:00100000:2.0:1789265682.301192:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399714176 00000100:00100000:2.0:1789265682.301317:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23 00000100:00100000:2.0:1789265682.301328:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+6:18696:x1876180399714176:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265682.301348:0:25384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265682.301369:0:25384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a985bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc411 expref: -99 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301442:0:25384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a985c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301456:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a985c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301471:0:25384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a985c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301488:0:25384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a985c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301496:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a985c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301503:0:25384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a985c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301638:0:25384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a985d0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301664:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a985d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301672:0:25384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a985d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265682.301704:0:25384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789265682.301707:0:25384:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789265682.301745:0:25384:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a985d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301757:0:25384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a985c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301773:0:25384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a985c2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301781:0:25384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a985c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301787:0:25384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265682.301792:0:25384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a985c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301799:0:25384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a985c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301810:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcb83b85800) 00010000:00010000:2.0:1789265682.301813:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265682.301817:0:25384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a985c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301833:0:25384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a985c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301848:0:25384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a985c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301854:0:25384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a985c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301859:0:25384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a985c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301864:0:25384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265682.301867:0:25384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a985c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301873:0:25384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a985c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301881:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fcb83b85100) 00010000:00010000:2.0:1789265682.301884:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265682.301887:0:25384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a985c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301893:0:25384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a985c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301925:0:25384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a985bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc411 expref: 8 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301950:0:25384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491600/0x9272d942b4a985d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc411 expref: 7 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.301958:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fcb83b85600) 00010000:00010000:2.0:1789265682.301960:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789265682.301962:0:25384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491600, rc 0) 00000100:00100000:2.0:1789265682.302065:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+7:18696:x1876180399714176:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 738us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265682.302072:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23 00000100:00100000:2.0:1789265682.306508:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265682.306886:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399714304 00000100:00100000:0.0:1789265682.306897:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399714304 00000100:00100000:0.0:1789265682.306991:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5 00000100:00100000:0.0:1789265682.307003:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c0c77789-04ce-4c79-87b2-012b259e18c5+7:18696:x1876180399714304:12345-192.168.203.49@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789265682.307108:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c0c77789-04ce-4c79-87b2-012b259e18c5+7:18696:x1876180399714304:12345-192.168.203.49@tcp:900:lhsmtool_posix.0 Request processed in 107us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265682.307116:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5 00010000:00010000:1.0:1789265682.307275:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265682.309665:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265682.309948:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399714560 00000100:00100000:3.0:1789265682.309957:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399714560 00000100:00100000:3.0:1789265682.310097:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:3.0:1789265682.310108:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+7:18696:x1876180399714560:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265682.310126:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265682.310147:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52200/0x9272d942b4a985d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc418 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310225:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a985de lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310239:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a985de lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310251:0:22761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a985de lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310288:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a985e5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310296:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a985e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310303:0:22761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a985e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310433:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6200/0x9272d942b4a985ec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310441:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6200/0x9272d942b4a985ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310449:0:22761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6200/0x9272d942b4a985ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265682.310457:0:22761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789265682.310632:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a985de lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310640:0:22761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a985de lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310647:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a985de lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310652:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265682.310657:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a985de lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310674:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a985de lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310686:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fcb83b85600) 00010000:00010000:3.0:1789265682.310689:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265682.310693:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a985de lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310700:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a985de lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310713:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a985e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310719:0:22761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a985e5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310725:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a985e5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310730:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265682.310733:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a985e5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310739:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a985e5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310746:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fcc83bd4c00) 00010000:00010000:3.0:1789265682.310748:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265682.310751:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a985e5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.310779:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a985e5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.312005:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcb83f52200/0x9272d942b4a985d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc418 expref: 10 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.312435:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6200/0x9272d942b4a985ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc418 expref: 9 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.312446:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fcc83bd4f00) 00010000:00010000:3.0:1789265682.312449:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265682.312453:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6200, rc 0) 00000100:00100000:3.0:1789265682.312553:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+9:18696:x1876180399714560:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 2445us (2894us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1789265682.312561:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:2.0:1789265682.316302:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265682.316391:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399714688 00000100:00100000:3.0:1789265682.316402:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399714688 00000100:00100000:3.0:1789265682.316456:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 25 00000100:00100000:3.0:1789265682.316466:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+9:18696:x1876180399714688:12345-192.168.203.49@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789265682.316556:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+9:18696:x1876180399714688:12345-192.168.203.49@tcp:59:lhsmtool_posix.0 Request processed in 91us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265682.316564:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 25 00000100:00100000:2.0:1789265682.319678:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265682.319802:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399714816 00000100:00100000:0.0:1789265682.319812:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399714816 00000100:00100000:0.0:1789265682.319878:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 26 00000100:00100000:0.0:1789265682.319889:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+5:18696:x1876180399714816:12345-192.168.203.49@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1789265682.321426:0:22759:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1492us 00000100:00100000:0.0:1789265682.340683:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+5:18696:x1876180399714816:12345-192.168.203.49@tcp:59:lhsmtool_posix.0 Request processed in 20775us (20992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265682.340698:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 26 00000100:00100000:0.0:1789265682.369143:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265682.369248:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399714944 00000100:00100000:3.0:1789265682.369259:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399714944 00000100:00100000:3.0:1789265682.369312:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 27 00000100:00100000:3.0:1789265682.369323:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+9:18702:x1876180399714944:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265682.369356:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265682.369377:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a985fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc41f expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369437:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a98601 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369453:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a98601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369465:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a98601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369481:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98608 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369489:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369496:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369538:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a98601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369546:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a98601 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369552:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a98601 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369558:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265682.369568:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a98601 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369576:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a98601 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369588:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcb83b85800) 00010000:00010000:3.0:1789265682.369591:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265682.369596:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a98601 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369602:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a98601 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369624:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369630:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98608 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369636:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98608 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369641:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265682.369644:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98608 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369651:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98608 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.369658:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fcc83bd4c00) 00010000:00010000:3.0:1789265682.369661:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265682.369670:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98608 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.370009:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98608 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.370111:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a985fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc41f expref: 10 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.370123:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcb83b85800) 00010000:00010000:3.0:1789265682.370126:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265682.370130:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a985fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc41f expref: 10 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.370140:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6800, rc 0) 00000100:00100000:3.0:1789265682.370196:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+9:18702:x1876180399714944:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 876us (1063us total) trans 0 rc 301/301 00000100:00100000:3.0:1789265682.370204:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 27 00000100:00100000:3.0:1789265682.377008:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265682.380464:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399715072 00000100:00100000:1.0:1789265682.380482:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399715072 00000100:00100000:1.0:1789265682.380642:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:1.0:1789265682.380656:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c0c77789-04ce-4c79-87b2-012b259e18c5+9:18702:x1876180399715072:12345-192.168.203.49@tcp:700:lfs.0 00000100:00100000:1.0:1789265682.380746:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c0c77789-04ce-4c79-87b2-012b259e18c5+9:18702:x1876180399715072:12345-192.168.203.49@tcp:700:lfs.0 Request processed in 94us (3747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265682.380754:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:1.0:1789265682.385101:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265682.385326:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399715328 00000100:00100000:3.0:1789265682.385335:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399715328 00000100:00100000:3.0:1789265682.385438:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 28 00000100:00100000:3.0:1789265682.385449:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+9:18702:x1876180399715328:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:3.0:1789265682.385499:0:22761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265682.385523:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98528 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc38c expref: 9 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.385543:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcb83b85800) 00010000:00010000:3.0:1789265682.385560:0:22761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265682.385629:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9860f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.385643:0:22761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc80030400/0x9272d942b4a98567 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3fc expref: 5 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.385652:0:22761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9860f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.385769:0:22761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc80030400/0x9272d942b4a98567 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3fc expref: 5 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.385783:0:22761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc80030400/0x9272d942b4a98567 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3fc expref: 5 pid: 25384 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265682.385797:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22761:1876180417649920:192.168.203.49@tcp:104: 00000100:00100000:3.0:1789265682.386456:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c48900 going to sleep for 11 seconds 00000100:00100000:3.0:1789265682.389088:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22761:1876180417649920:192.168.203.49@tcp:104: 00010000:00010000:3.0:1789265682.389117:0:22761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9860f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265682.399837:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265682.399993:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399715456 00000100:00100000:0.0:1789265682.400004:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399715456 00010000:00010000:0.0:1789265682.400762:0:22745:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc80030400/0x9272d942b4a98567 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3fc expref: 6 pid: 25384 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265682.401066:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00100000:0.0:1789265682.401089:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+6:2395:x1876180399715456:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265682.401106:0:22745:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265682.401114:0:22745:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc80030400/0x9272d942b4a98567 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3fc expref: 6 pid: 25384 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.401137:0:22745:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc80030400/0x9272d942b4a98567 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3fc expref: 6 pid: 25384 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.401167:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc80030400/0x9272d942b4a98567 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc3fc expref: 6 pid: 25384 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.401185:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcb83b85800) 00010000:00010000:0.0:1789265682.401191:0:22745:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9860f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.401200:0:22745:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9860f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.401207:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9860f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.401239:0:22745:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265682.401303:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2395:x1876180399715456:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 217us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265682.401311:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 15 00010000:00010000:3.0:1789265682.401373:0:22761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9860f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.401382:0:22761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9860f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.401405:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98616 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.401438:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98616 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.401447:0:22761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98616 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.405270:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a9861d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.405294:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a9861d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.405306:0:22761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a9861d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265682.405323:0:22761:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078f7f614 reply state 000000001fade6ee transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a9861d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.405334:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a9861d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.405341:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fcc83bd4600) 00010000:00010000:3.0:1789265682.405344:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265682.405348:0:22761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789265682.405353:0:22761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789265682.405362:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9860f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.405368:0:22761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9860f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.405376:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9860f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.405389:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265682.405393:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9860f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.405401:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9860f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.405413:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcb83b85800) 00010000:00010000:3.0:1789265682.405415:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265682.405528:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9860f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.405537:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9860f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265682.405557:0:22761:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078f7f614 reply state 000000001fade6ee transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98616 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.405693:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98616 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.405701:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fcc83bd4c00) 00010000:00010000:3.0:1789265682.405703:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265682.405705:0:22761:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789265682.405853:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+10:18702:x1876180399715328:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 20402us (20756us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789265682.405863:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 28 00000100:00100000:2.0:1789265682.509558:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265682.510835:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399715584 00000100:00100000:3.0:1789265682.510847:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399715584 00000100:00100000:3.0:1789265682.510922:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00100000:3.0:1789265682.510950:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+10:18710:x1876180399715584:12345-192.168.203.49@tcp:101:lctl.0 00010000:00010000:3.0:1789265682.510974:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265682.510996:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a98624 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc426 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.511079:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a9862b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.511093:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a9862b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.511104:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a9862b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265682.511146:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789265682.511161:0:22760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265682.511211:0:22760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a9862b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.511235:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a98624 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc426 expref: 12 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.511252:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6c00/0x9272d942b4a9862b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc426 expref: 11 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.511261:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc83bd4800) 00010000:00010000:3.0:1789265682.511264:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265682.511267:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6c00, rc 0) 00000100:00100000:3.0:1789265682.511323:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+11:18710:x1876180399715584:12345-192.168.203.49@tcp:101:lctl.0 Request processed in 377us (1774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265682.511340:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00100000:1.0:1789265682.539148:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265682.539284:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399715712 00000100:00100000:0.0:1789265682.539293:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399715712 00000100:00100000:0.0:1789265682.539353:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 30 00000100:00100000:0.0:1789265682.539364:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed7caf6-20fa-460c-bf48-65425dcf3952+5:18711:x1876180399715712:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1789265682.539383:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265682.539403:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a98632 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc42d expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.539464:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692000/0x9272d942b4a98639 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.539479:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692000/0x9272d942b4a98639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.539491:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692000/0x9272d942b4a98639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265682.539531:0:22759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789265682.539535:0:22759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265682.539556:0:22759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692000/0x9272d942b4a98639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.539731:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a98632 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc42d expref: 7 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.539754:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692000/0x9272d942b4a98639 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc42d expref: 6 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.539781:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc83bd4800) 00010000:00010000:0.0:1789265682.539784:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265682.539788:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692000, rc 0) 00000100:00100000:0.0:1789265682.539850:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fed7caf6-20fa-460c-bf48-65425dcf3952+6:18711:x1876180399715712:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 488us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265682.539857:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 30 00000100:00100000:0.0:1789265682.544104:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265682.544187:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399715840 00000100:00100000:3.0:1789265682.544197:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399715840 00000100:00100000:3.0:1789265682.544255:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 31 00000100:00100000:3.0:1789265682.544264:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+6:18711:x1876180399715840:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265682.544285:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265682.544305:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a98640 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc434 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544373:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a98647 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544388:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a98647 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544400:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a98647 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544412:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9864e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544419:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9864e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544426:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9864e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544496:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a98655 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544523:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a98655 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544530:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a98655 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265682.544568:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789265682.544572:0:22760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265682.544591:0:22760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a98655 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544602:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a98647 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544619:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a98647 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544626:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a98647 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544632:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7400 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265682.544636:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a98647 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544643:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a98647 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544655:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc83bd4800) 00010000:00010000:3.0:1789265682.544658:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265682.544662:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a98647 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544679:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a98647 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544692:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9864e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544698:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9864e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544704:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9864e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544709:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265682.544712:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9864e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544718:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9864e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544726:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fcc83bd4c00) 00010000:00010000:3.0:1789265682.544729:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265682.544731:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9864e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544737:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9864e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544762:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a98640 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc434 expref: 8 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544787:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a98655 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc434 expref: 7 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.544794:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fcc83bd4600) 00010000:00010000:3.0:1789265682.544796:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265682.544799:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7e00, rc 0) 00000100:00100000:3.0:1789265682.544854:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+7:18711:x1876180399715840:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 590us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265682.544861:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 31 00000100:00100000:2.0:1789265682.548254:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265682.548341:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399715968 00000100:00100000:0.0:1789265682.548351:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399715968 00000100:00100000:0.0:1789265682.548406:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:0.0:1789265682.548417:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fed7caf6-20fa-460c-bf48-65425dcf3952+5:18711:x1876180399715968:12345-192.168.203.49@tcp:900:lfs.0 00000100:00100000:0.0:1789265682.548495:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fed7caf6-20fa-460c-bf48-65425dcf3952+5:18711:x1876180399715968:12345-192.168.203.49@tcp:900:lfs.0 Request processed in 80us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265682.548503:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:1.0:1789265682.551814:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265682.551901:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399716224 00000100:00100000:3.0:1789265682.551911:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399716224 00000100:00100000:3.0:1789265682.551970:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 32 00000100:00100000:3.0:1789265682.551980:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+7:18711:x1876180399716224:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265682.551999:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265682.552057:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a9865c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc43b expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265682.552150:0:22761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789265682.552267:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a9865c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc43b expref: 9 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.552281:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc83bd4800) 00010000:00010000:3.0:1789265682.552284:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265682.552289:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a9865c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc43b expref: 9 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.552321:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6a00, rc 0) 00000100:00100000:3.0:1789265682.552381:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+8:18711:x1876180399716224:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 403us (577us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1789265682.552389:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 32 00000100:00100000:1.0:1789265682.555459:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265682.555547:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399716480 00000100:00100000:3.0:1789265682.555556:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399716480 00000100:00100000:3.0:1789265682.555630:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 33 00000100:00100000:3.0:1789265682.555641:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+8:18711:x1876180399716480:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:3.0:1789265682.555693:0:22760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265682.555720:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a98655 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc434 expref: 8 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.555737:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fcc83bd4600) 00010000:00010000:3.0:1789265682.555741:0:22760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265682.555762:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9866a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.555775:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9866a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.555784:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9866a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789265682.555958:0:22760:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068390033 reply state 0000000067308282 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9866a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.555971:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9866a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.555988:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fcc83bd4600) 00010000:00010000:3.0:1789265682.555991:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1789265682.555993:0:22760:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789265682.556001:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789265682.556108:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+9:18711:x1876180399716480:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 468us (656us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1789265682.556116:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 33 00000100:00100000:2.0:1789265682.558878:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265682.559058:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399716736 00000100:00100000:0.0:1789265682.559066:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399716736 00000100:00100000:0.0:1789265682.559119:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 2 00000100:00100000:0.0:1789265682.559130:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+9:18711:x1876180399716736:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:0.0:1789265682.559342:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+10:18711:x1876180399716736:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 213us (470us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1789265682.559350:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 2 00000100:00100000:1.0:1789265682.562842:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265682.562937:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399716992 00000100:00100000:3.0:1789265682.562946:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399716992 00000100:00100000:3.0:1789265682.563010:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 34 00000100:00100000:3.0:1789265682.563020:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+10:18711:x1876180399716992:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265682.563067:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265682.563086:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a98671 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc442 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563166:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a98678 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563180:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a98678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563191:0:22761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a98678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563203:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9867f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563210:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9867f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563237:0:22761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9867f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265682.563329:0:22761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789265682.563396:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a98678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563403:0:22761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a98678 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563409:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a98678 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563414:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6a00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265682.563418:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a98678 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563425:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a98678 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563437:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc83bd4800) 00010000:00010000:3.0:1789265682.563440:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265682.563444:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a98678 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563450:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a98678 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563462:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9867f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563477:0:22761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9867f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563484:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9867f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563489:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265682.563492:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9867f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563498:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9867f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563505:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fcc83bd4c00) 00010000:00010000:3.0:1789265682.563507:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265682.563510:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9867f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563515:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a9867f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563546:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a98671 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc442 expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563556:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc83bd4800) 00010000:00010000:3.0:1789265682.563558:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265682.563561:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a98671 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc442 expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.563594:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7e00, rc 0) 00000100:00100000:3.0:1789265682.563662:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+11:18711:x1876180399716992:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 643us (829us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1789265682.563670:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 34 00000100:00100000:1.0:1789265682.566898:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265682.566979:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399717120 00000100:00100000:3.0:1789265682.566990:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399717120 00000100:00100000:3.0:1789265682.567076:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 35 00000100:00100000:3.0:1789265682.567086:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+11:18711:x1876180399717120:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265682.567107:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265682.567128:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a9868d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc449 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.567334:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a98694 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.567348:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a98694 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.567358:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a98694 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265682.567384:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789265682.567388:0:22760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265682.567408:0:22760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a98694 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.567435:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a9868d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc449 expref: 13 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.567473:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a98694 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc449 expref: 12 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.567481:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fcc83bd4600) 00010000:00010000:3.0:1789265682.567484:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789265682.567487:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6400, rc 0) 00000100:00100000:3.0:1789265682.567601:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+12:18711:x1876180399717120:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 516us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265682.567618:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 35 00000100:00100000:2.0:1789265682.572265:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265682.572361:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399717248 00000100:00100000:0.0:1789265682.572371:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399717248 00000100:00100000:0.0:1789265682.572461:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:0.0:1789265682.572472:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+12:18711:x1876180399717248:12345-192.168.203.49@tcp:37:lfs.0 00000100:00100000:0.0:1789265682.577512:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fed7caf6-20fa-460c-bf48-65425dcf3952+12:18711:x1876180399717248:12345-192.168.203.49@tcp:37:lfs.0 Request processed in 5033us (5247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265682.577526:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:1.0:1789265682.580828:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265682.580983:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399717504 00000100:00100000:2.0:1789265682.580992:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399717504 00000100:00100000:2.0:1789265682.581232:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:2.0:1789265682.581244:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83cf2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fed7caf6-20fa-460c-bf48-65425dcf3952+12:18711:x1876180399717504:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:2.0:1789265682.581508:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83cf2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fed7caf6-20fa-460c-bf48-65425dcf3952+13:18711:x1876180399717504:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 265us (687us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1789265682.581517:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 4 00000040:00080000:2.0:1789265682.626965:0:22793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789265682.663445:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265682.663596:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399717632 00000100:00100000:3.0:1789265682.663605:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399717632 00000100:00100000:3.0:1789265682.663675:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 36 00000100:00100000:3.0:1789265682.663687:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+11:18717:x1876180399717632:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1789265682.663706:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265682.663725:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a9869b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc450 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.663786:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a986a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.663800:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a986a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.663811:0:22761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a986a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.663822:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a986a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.663843:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a986a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.663851:0:22761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a986a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.663941:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a986b0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.663950:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a986b0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.663957:0:22761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a986b0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265682.663989:0:22761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789265682.663993:0:22761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789265682.664526:0:22761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a986b0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.664541:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a986a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.664547:0:22761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a986a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.664554:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a986a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.664561:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265682.664565:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a986a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.664579:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a986a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.664591:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc83bd4800) 00010000:00010000:3.0:1789265682.664594:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265682.664599:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a986a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.664605:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a986a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.664627:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a986a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.664633:0:22761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a986a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.664638:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a986a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.664644:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265682.664646:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a986a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.664652:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a986a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.664659:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fcc83bd4c00) 00010000:00010000:3.0:1789265682.664662:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265682.664665:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a986a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.664681:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a986a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.664711:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a9869b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc450 expref: 13 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.664724:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6a00/0x9272d942b4a986b0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc450 expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.664731:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fcc83bd4600) 00010000:00010000:3.0:1789265682.664733:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789265682.664736:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6a00, rc 0) 00000100:00100000:3.0:1789265682.664801:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+12:18717:x1876180399717632:12345-192.168.203.49@tcp:101:bash.0 Request processed in 1116us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265682.664808:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 36 00000100:00100000:1.0:1789265682.668864:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265682.669012:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399717760 00000100:00100000:0.0:1789265682.669062:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399717760 00000100:00100000:0.0:1789265682.669113:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:0.0:1789265682.669124:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c0c77789-04ce-4c79-87b2-012b259e18c5+5:18717:x1876180399717760:12345-192.168.203.49@tcp:900:bash.0 00000100:00100000:0.0:1789265682.669384:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c0c77789-04ce-4c79-87b2-012b259e18c5+5:18717:x1876180399717760:12345-192.168.203.49@tcp:900:bash.0 Request processed in 261us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265682.669393:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:1.0:1789265682.678205:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265682.678340:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399718016 00000100:00100000:2.0:1789265682.678349:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399718016 00000100:00100000:2.0:1789265682.678407:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 37 00000100:00100000:2.0:1789265682.678417:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+12:18717:x1876180399718016:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1789265682.678436:0:25384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265682.678457:0:25384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491800/0x9272d942b4a986b7 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc457 expref: -99 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.678558:0:25384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a986be lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.678574:0:25384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a98694 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc449 expref: 12 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.678582:0:25384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a986be lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.678626:0:25384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a98694 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc449 expref: 12 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.678639:0:25384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a98694 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc449 expref: 12 pid: 22760 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265682.678651:0:25384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb8286a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25384:1876180417650048:192.168.203.49@tcp:104: 00000100:00100000:2.0:1789265682.678732:0:25384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb822b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1789265682.683651:0:25384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb8286a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25384:1876180417650048:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265682.683680:0:25384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a986be lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265682.685687:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265682.686004:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399718144 00000100:00100000:3.0:1789265682.686013:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399718144 00010000:00010000:3.0:1789265682.686102:0:22744:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a98694 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc449 expref: 13 pid: 22760 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265682.686141:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:3.0:1789265682.686161:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb7bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fed7caf6-20fa-460c-bf48-65425dcf3952+13:2396:x1876180399718144:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265682.686176:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265682.686184:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a98694 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc449 expref: 13 pid: 22760 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.686211:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a98694 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc449 expref: 13 pid: 22760 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.686234:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a98694 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc449 expref: 13 pid: 22760 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.686249:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fcc83bd4600) 00010000:00010000:3.0:1789265682.686254:0:22744:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a986be lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.686263:0:22744:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a986be lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.686270:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a986be lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.686304:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265682.686352:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb7bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fed7caf6-20fa-460c-bf48-65425dcf3952+12:2396:x1876180399718144:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 202us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265682.686360:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 16 00010000:00010000:2.0:1789265682.686486:0:25384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a986be lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.686506:0:25384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a986be lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.686566:0:25384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a986c5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.686576:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a986c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.686584:0:25384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a986c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.687092:0:25384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a986cc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.687104:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a986cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.687111:0:25384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a986cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265682.687122:0:25384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789265682.687147:0:25384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a986be lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.687155:0:25384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a986be lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.687162:0:25384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a986be lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.687169:0:25384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265682.687180:0:25384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a986be lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.687188:0:25384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a986be lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.687198:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fcc83bd4600) 00010000:00010000:2.0:1789265682.687201:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789265682.687205:0:25384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a986be lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.687211:0:25384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a986be lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265682.687225:0:25384:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010e0a4c7 reply state 0000000067dba909 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a986c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.687236:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a986c5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.687242:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9fcb83b85100) 00010000:00010000:2.0:1789265682.687245:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265682.687247:0:25384:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789265682.687279:0:25384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491800/0x9272d942b4a986b7 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc457 expref: 15 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.687295:0:25384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a986cc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc457 expref: 14 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.687303:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:2.0:1789265682.687305:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789265682.687313:0:25384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491000, rc 0) 00000100:00100000:2.0:1789265682.687349:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+15:18717:x1876180399718016:12345-192.168.203.49@tcp:101:bash.0 Request processed in 8933us (9153us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1789265682.687357:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 37 00000100:00100000:2.0:1789265682.724473:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265682.724582:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399718272 00000100:00100000:0.0:1789265682.724592:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399718272 00000100:00100000:0.0:1789265682.724659:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 38 00000100:00100000:0.0:1789265682.724670:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+15:18717:x1876180399718272:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1789265682.724707:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265682.724728:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692a00/0x9272d942b4a986da lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc45e expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.724791:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a986e1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.724806:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a986e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.724816:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a986e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265682.724863:0:22759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789265682.724911:0:22759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265682.724935:0:22759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a986e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.724945:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a986e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.724969:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692a00/0x9272d942b4a986da lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc45e expref: 17 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.724985:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a986e1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc45e expref: 16 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265682.724992:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:0.0:1789265682.724995:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265682.724998:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692600, rc 0) 00000100:00100000:0.0:1789265682.725884:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+16:18717:x1876180399718272:12345-192.168.203.49@tcp:101:bash.0 Request processed in 1212us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265682.725893:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 38 00000100:00100000:0.0:1789265682.733061:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265682.733188:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399718528 00000100:00100000:2.0:1789265682.733197:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399718528 00000100:00100000:2.0:1789265682.733252:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5 00000100:00100000:2.0:1789265682.733262:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+16:18717:x1876180399718528:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:2.0:1789265682.733528:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+17:18717:x1876180399718528:12345-192.168.203.49@tcp:35:bash.0 Request processed in 267us (508us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1789265682.733536:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5 00000040:00080000:0.0:1789265682.754965:0:23512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789265682.878555:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265682.878700:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399718784 00000100:00100000:3.0:1789265682.878715:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399718784 00000100:00100000:3.0:1789265682.878842:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 39 00000100:00100000:3.0:1789265682.878854:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+17:18727:x1876180399718784:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265682.878877:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265682.878908:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a986e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc465 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265682.879084:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789265682.879196:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a986e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc465 expref: 19 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.879211:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc83bd4800) 00010000:00010000:3.0:1789265682.879215:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789265682.879219:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a986e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc465 expref: 19 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.879232:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6400, rc 0) 00000100:00100000:3.0:1789265682.879310:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+18:18727:x1876180399718784:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 459us (772us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1789265682.879318:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 39 00000100:00100000:2.0:1789265682.893195:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265682.893604:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399719040 00000100:00100000:0.0:1789265682.893623:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399719040 00000100:00100000:0.0:1789265682.893688:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:0.0:1789265682.893699:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+18:18727:x1876180399719040:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:0.0:1789265682.893915:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+19:18727:x1876180399719040:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 216us (726us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1789265682.893923:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:0.0:1789265682.941340:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265682.947309:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399719296 00000100:00100000:3.0:1789265682.947322:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399719296 00000100:00100000:3.0:1789265682.949672:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 40 00000100:00100000:3.0:1789265682.949696:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+19:18730:x1876180399719296:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1789265682.949721:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265682.949742:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a986f6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc46c expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.949848:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a986fd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.949863:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a986fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265682.949894:0:22761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a986fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265682.949906:0:22761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789265682.953207:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6400/0x9272d942b4a986f6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc46c expref: 22 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.953235:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a986fd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc46c expref: 21 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.953245:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:2.0:1789265682.953248:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265682.953251:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7400, rc 0) 00000100:00100000:2.0:1789265682.953338:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+21:18730:x1876180399719296:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 3654us (12005us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1789265682.953346:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 40 00000100:00100000:1.0:1789265682.961531:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265682.966642:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399719424 00000100:00100000:2.0:1789265682.966683:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399719424 00000100:00100000:2.0:1789265682.966828:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 41 00000100:00100000:2.0:1789265682.966840:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb7bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+21:18730:x1876180399719424:12345-192.168.203.49@tcp:54:lfs.0 00010000:00010000:2.0:1789265682.966926:0:25384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a9870b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.966944:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a9870b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.966956:0:25384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a9870b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.966991:0:25384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a9870b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.966998:0:25384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a9870b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.967004:0:25384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a9870b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.967010:0:25384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:2.0:1789265682.967015:0:25384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a9870b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.967039:0:25384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a9870b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.967060:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:2.0:1789265682.967064:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789265682.967068:0:25384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a9870b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.967085:0:25384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a9870b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265682.967166:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb7bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+21:18730:x1876180399719424:12345-192.168.203.49@tcp:54:lfs.0 Request processed in 328us (6292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265682.967174:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 41 00000100:00100000:0.0:1789265682.995140:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265682.996338:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265682.997833:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399719552 00000100:00100000:2.0:1789265682.997848:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399719552 00000100:00100000:2.0:1789265682.997913:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:2.0:1789265682.997924:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+21:2396:x1876180399719552:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265682.997940:0:22746:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265682.997965:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7400/0x9272d942b4a986fd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc46c expref: 21 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265682.997984:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:2.0:1789265682.997989:0:22746:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265682.998087:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+20:2396:x1876180399719552:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 165us (2956us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265682.998094:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:1.0:1789265683.000828:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399719808 00000100:00100000:1.0:1789265683.000844:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399719808 00000100:00100000:1.0:1789265683.001301:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:1.0:1789265683.001312:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+20:18730:x1876180399719808:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:1.0:1789265683.001561:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+21:18730:x1876180399719808:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 250us (5413us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1789265683.001568:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 7 00010000:00010000:3.0:1789265683.331427:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789265683.425643:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265683.425742:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399720064 00000100:00100000:2.0:1789265683.425752:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399720064 00000100:00100000:2.0:1789265683.425811:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 42 00000100:00100000:2.0:1789265683.425822:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+21:18761:x1876180399720064:12345-192.168.203.49@tcp:101:cat.0 00010000:00010000:2.0:1789265683.425846:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265683.425866:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98712 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc473 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265683.425987:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a98719 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265683.426002:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a98719 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265683.426014:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a98719 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789265683.426061:0:22759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789265683.426183:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98712 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc473 expref: 24 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265683.426202:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a98719 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc473 expref: 23 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265683.426210:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:2.0:1789265683.426213:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789265683.426215:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491e00, rc 0) 00000100:00100000:2.0:1789265683.426275:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+23:18761:x1876180399720064:12345-192.168.203.49@tcp:101:cat.0 Request processed in 455us (640us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1789265683.426282:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 42 00000100:00100000:0.0:1789265683.458123:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265683.458266:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399720320 00000100:00100000:2.0:1789265683.458276:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399720320 00000100:00100000:2.0:1789265683.458335:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:2.0:1789265683.458344:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+23:18761:x1876180399720320:12345-192.168.203.49@tcp:35:cat.0 00000100:00100000:2.0:1789265683.458635:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+24:18761:x1876180399720320:12345-192.168.203.49@tcp:35:cat.0 Request processed in 292us (521us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1789265683.458656:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:3.0:1789265683.461135:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265683.461274:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399720448 00000100:00100000:0.0:1789265683.461283:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399720448 00000100:00100000:0.0:1789265683.461346:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1 00000100:00100000:0.0:1789265683.461357:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+24:2396:x1876180399720448:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265683.461371:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265683.461392:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a98719 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc473 expref: 24 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265683.461412:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:0.0:1789265683.461417:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265683.461465:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+23:2396:x1876180399720448:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 111us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265683.461472:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1 00000100:00100000:2.0:1789265683.602116:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265683.602190:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399720704 00000100:00100000:3.0:1789265683.602199:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399720704 00000100:00100000:3.0:1789265683.602258:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 43 00000100:00100000:3.0:1789265683.602268:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+23:18767:x1876180399720704:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:3.0:1789265683.602289:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265683.602307:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a98727 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc47a expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265683.602407:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a9872e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265683.602420:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a9872e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265683.602441:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a9872e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789265683.602451:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789265683.602572:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a98727 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc47a expref: 26 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265683.602586:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a9872e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc47a expref: 25 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265683.602621:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:3.0:1789265683.602624:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265683.602627:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7e00, rc 0) 00000100:00100000:3.0:1789265683.602686:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+25:18767:x1876180399720704:12345-192.168.203.49@tcp:101:dd.0 Request processed in 420us (700us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1789265683.602693:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 43 00000100:00100000:3.0:1789265683.607559:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265683.607713:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399720832 00000100:00100000:2.0:1789265683.607722:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399720832 00000100:00100000:2.0:1789265683.607781:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 2 00000100:00100000:2.0:1789265683.607790:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+25:2396:x1876180399720832:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789265683.607804:0:22746:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265683.607824:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7e00/0x9272d942b4a9872e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc47a expref: 25 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265683.607841:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:2.0:1789265683.607845:0:22746:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789265683.607898:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+24:2396:x1876180399720832:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 109us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265683.607905:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 2 00000100:00100000:0.0:1789265683.632389:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265683.633278:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399720960 00000100:00100000:2.0:1789265683.633295:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399720960 00000100:00100000:2.0:1789265683.633385:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 44 00000100:00100000:2.0:1789265683.633398:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+24:18767:x1876180399720960:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1789265683.633429:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265683.634326:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a9873c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc481 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265683.634376:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98743 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265683.634393:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98743 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265683.634426:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98743 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265683.635412:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a9873c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc481 expref: 26 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265683.636486:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98743 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc481 expref: 25 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265683.636503:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:2.0:1789265683.636507:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265683.636512:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490600, rc 0) 00000100:00100000:2.0:1789265683.636641:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+25:18767:x1876180399720960:12345-192.168.203.49@tcp:101:dd.0 Request processed in 3244us (4265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265683.641070:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 44 00000100:00100000:3.0:1789265683.645226:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265683.645499:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399721216 00000100:00100000:1.0:1789265683.645512:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399721216 00000100:00100000:1.0:1789265683.645595:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 45 00000100:00100000:1.0:1789265683.645619:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+25:18767:x1876180399721216:12345-192.168.203.49@tcp:36:dd.0 00010000:00010000:1.0:1789265683.645694:0:22760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265683.645733:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692600/0x9272d942b4a986e1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc45e expref: 25 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265683.645768:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:1.0:1789265683.645775:0:22760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265683.646002:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6800/0x9272d942b4a9874a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265683.646019:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6800/0x9272d942b4a9874a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265683.646072:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6800/0x9272d942b4a9874a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789265683.646167:0:22760:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1789265683.646194:0:22760:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b4a406a reply state 00000000381a6096 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6800/0x9272d942b4a9874a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265683.646208:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6800/0x9272d942b4a9874a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265683.646215:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:1.0:1789265683.646217:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789265683.646220:0:22760:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789265683.646348:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+27:18767:x1876180399721216:12345-192.168.203.49@tcp:36:dd.0 Request processed in 732us (1135us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1789265683.646356:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 45 00000020:00080000:1.0:1789265683.646362:0:22760:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789265683.846406:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265683.857241:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399721472 00000100:00100000:2.0:1789265683.857265:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399721472 00000100:00100000:2.0:1789265683.857415:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:2.0:1789265683.857427:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+27:18767:x1876180399721472:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:0.0:1789265683.862442:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+28:18767:x1876180399721472:12345-192.168.203.49@tcp:35:dd.0 Request processed in 5000us (16034us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1789265683.862458:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:3.0:1789265683.969378:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417650176:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789265683.969482:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265683.969685:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417650176 00000100:00100000:2.0:1789265683.969697:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417650176 00000100:00100000:2.0:1789265683.969765:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789265683.969775:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417650176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789265683.969846:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789265683.970233:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876180417650176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 450us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265683.970261:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789265683.970425:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876180417650176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265683.971564:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789265683.971590:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417650432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789265683.972280:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265683.972429:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417650432 00000100:00100000:0.0:1789265683.972438:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417650432 00000100:00100000:0.0:1789265683.972512:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789265683.972522:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb7bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417650432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265683.972551:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789265683.972631:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb7bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417650432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265683.972650:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1789265683.972922:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789265683.972970:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417650432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265683.972973:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789265683.972998:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417650304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789265683.973120:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265683.977173:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417650304 00000100:00100000:1.0:1789265683.977189:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417650304 00000100:00100000:1.0:1789265683.977275:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789265683.977286:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417650304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789265683.977322:0:22765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789265683.977423:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417650304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (4304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265683.977431:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789265683.977541:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417650304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789265684.259219:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265684.259392:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399721600 00000100:00100000:1.0:1789265684.259405:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399721600 00000100:00100000:1.0:1789265684.259505:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 46 00000100:00100000:1.0:1789265684.259520:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+28:18781:x1876180399721600:12345-192.168.203.49@tcp:101:stat.0 00010000:00010000:1.0:1789265684.259551:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265684.259589:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6c00/0x9272d942b4a98751 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc488 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.259687:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6a00/0x9272d942b4a98758 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.259706:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6a00/0x9272d942b4a98758 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.259723:0:22761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6a00/0x9272d942b4a98758 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.259736:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7600/0x9272d942b4a9875f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.259744:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7600/0x9272d942b4a9875f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.259749:0:22761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7600/0x9272d942b4a9875f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.259849:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6e00/0x9272d942b4a98766 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.259925:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6e00/0x9272d942b4a98766 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.259956:0:22761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6e00/0x9272d942b4a98766 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265684.260010:0:22761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789265684.260015:0:22761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265684.260114:0:22761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6e00/0x9272d942b4a98766 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260129:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6e00/0x9272d942b4a98766 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260503:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6a00/0x9272d942b4a98758 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260513:0:22761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6a00/0x9272d942b4a98758 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260521:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6a00/0x9272d942b4a98758 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260528:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c6a00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265684.260533:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6a00/0x9272d942b4a98758 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260542:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6a00/0x9272d942b4a98758 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260559:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fcc83bd4600) 00010000:00010000:1.0:1789265684.260562:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265684.260568:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6a00/0x9272d942b4a98758 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260593:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6a00/0x9272d942b4a98758 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260619:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7600/0x9272d942b4a9875f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260625:0:22761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7600/0x9272d942b4a9875f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260630:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7600/0x9272d942b4a9875f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260635:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c7600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265684.260639:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7600/0x9272d942b4a9875f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260645:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7600/0x9272d942b4a9875f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260654:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9fcb83b85100) 00010000:00010000:1.0:1789265684.260657:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265684.260660:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7600/0x9272d942b4a9875f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260665:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7600/0x9272d942b4a9875f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260706:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6c00/0x9272d942b4a98751 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc488 expref: 30 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260732:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6e00/0x9272d942b4a98766 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc488 expref: 29 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.260739:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:1.0:1789265684.260742:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265684.260744:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb71c6e00, rc 0) 00000100:00100000:1.0:1789265684.260828:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+29:18781:x1876180399721600:12345-192.168.203.49@tcp:101:stat.0 Request processed in 1313us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265684.260838:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 46 00000100:00080000:2.0:1789265684.260997:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789265684.359832:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265684.395481:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265684.395821:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399721856 00000100:00100000:2.0:1789265684.395835:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399721856 00000100:00100000:2.0:1789265684.395920:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 47 00000100:00100000:2.0:1789265684.395931:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+29:18787:x1876180399721856:12345-192.168.203.49@tcp:36:truncate.0 00010000:00010000:2.0:1789265684.396000:0:25384:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265684.396078:0:25384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6e00/0x9272d942b4a98766 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc488 expref: 29 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265684.396101:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:2.0:1789265684.396107:0:25384:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265684.396364:0:25384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a9876d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265684.396382:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a9876d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265684.396394:0:25384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a9876d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265684.396443:0:25384:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:2.0:1789265684.396469:0:25384:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7425f81 reply state 0000000026f76b2e transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a9876d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265684.396483:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a9876d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265684.396511:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:2.0:1789265684.396514:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265684.396517:0:25384:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265684.397502:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+31:18787:x1876180399721856:12345-192.168.203.49@tcp:36:truncate.0 Request processed in 1565us (2028us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1789265684.397514:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 47 00000020:00080000:3.0:1789265684.397522:0:25384:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789265684.594277:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265684.594439:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399721984 00000100:00100000:0.0:1789265684.594452:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399721984 00000100:00100000:0.0:1789265684.594532:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 48 00000100:00100000:0.0:1789265684.594545:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+31:18801:x1876180399721984:12345-192.168.203.49@tcp:101:stat.0 00010000:00010000:0.0:1789265684.594586:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265684.594622:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692a00/0x9272d942b4a98774 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc48f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.594721:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a9877b lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.594740:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a9877b lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.594752:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a9877b lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.594764:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a98782 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.594771:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a98782 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.594777:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a98782 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.594890:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692400/0x9272d942b4a98789 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.594924:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692400/0x9272d942b4a98789 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.594931:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692400/0x9272d942b4a98789 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265684.594986:0:22759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1789265684.594991:0:22759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265684.595017:0:22759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692400/0x9272d942b4a98789 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595097:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692400/0x9272d942b4a98789 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595107:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a9877b lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595114:0:22759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a9877b lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595122:0:22759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a9877b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595129:0:22759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81693600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265684.595134:0:22759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a9877b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595343:0:22759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a9877b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595360:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fcc83bd4600) 00010000:00010000:0.0:1789265684.595371:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265684.595378:0:22759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a9877b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595384:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693600/0x9272d942b4a9877b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595404:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a98782 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595410:0:22759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a98782 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595416:0:22759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a98782 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595420:0:22759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81693e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265684.595422:0:22759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a98782 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595428:0:22759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a98782 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595434:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9fcb83b85100) 00010000:00010000:0.0:1789265684.595437:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265684.595440:0:22759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a98782 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595445:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a98782 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595483:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692a00/0x9272d942b4a98774 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc48f expref: 33 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595509:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692400/0x9272d942b4a98789 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc48f expref: 32 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.595516:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:0.0:1789265684.595518:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789265684.595521:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81692400, rc 0) 00000100:00100000:0.0:1789265684.595625:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+32:18801:x1876180399721984:12345-192.168.203.49@tcp:101:stat.0 Request processed in 1082us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265684.595762:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 48 00000100:00100000:0.0:1789265684.767977:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265684.768440:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399722240 00000100:00100000:1.0:1789265684.768453:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399722240 00000100:00100000:1.0:1789265684.768587:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 49 00000100:00100000:1.0:1789265684.768611:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+32:18811:x1876180399722240:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1789265684.768638:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265684.768668:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6c00/0x9272d942b4a98790 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc496 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265684.768805:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789265684.768948:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6c00/0x9272d942b4a98790 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc496 expref: 34 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.768965:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc83bd4800) 00010000:00010000:1.0:1789265684.768969:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265684.768973:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6c00/0x9272d942b4a98790 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc496 expref: 34 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.769011:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb71c6c00, rc 0) 00000100:00100000:1.0:1789265684.769151:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+33:18811:x1876180399722240:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 543us (1187us total) trans 12884901910 rc 301/301 00000100:00100000:1.0:1789265684.769158:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 49 00000100:00100000:3.0:1789265684.775477:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265684.777069:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399722496 00000100:00100000:1.0:1789265684.777090:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399722496 00000100:00100000:1.0:1789265684.777216:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 10 00000100:00100000:1.0:1789265684.777228:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83cf2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+33:18811:x1876180399722496:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:1.0:1789265684.777585:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83cf2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+34:18811:x1876180399722496:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 358us (2120us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1789265684.777604:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 10 00000100:00100000:2.0:1789265684.893541:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265684.893693:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399722752 00000100:00100000:0.0:1789265684.893707:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399722752 00000100:00100000:0.0:1789265684.893792:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 50 00000100:00100000:0.0:1789265684.893804:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+34:18817:x1876180399722752:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1789265684.893840:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265684.893869:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692a00/0x9272d942b4a9879e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc49d expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.894015:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.894066:0:22759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a986cc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc457 expref: 35 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.894076:0:22759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692400/0x9272d942b4a98789 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc48f expref: 35 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.894107:0:22759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.894152:0:22759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692400/0x9272d942b4a98789 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc48f expref: 35 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.894170:0:22759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692400/0x9272d942b4a98789 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc48f expref: 35 pid: 22759 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265684.894187:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b91500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22759:1876180417650560:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265684.894457:0:22759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a986cc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc457 expref: 35 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265684.894467:0:22759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a986cc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc457 expref: 35 pid: 25384 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265684.894478:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b91180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22759:1876180417650688:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265684.894499:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83275240 going to sleep for 11 seconds 00000100:00100000:0.0:1789265684.896886:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b91500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22759:1876180417650560:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265684.897008:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b91180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22759:1876180417650688:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265684.897063:0:22759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265684.910750:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265684.910799:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265684.911121:0:25787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399723008 00000100:00100000:1.0:1789265684.911295:0:25787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399723008 00010000:00010000:1.0:1789265684.911351:0:25787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a986cc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc457 expref: 36 pid: 25384 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265684.911392:0:25787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399722880 00000100:00100000:1.0:1789265684.911396:0:25787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399722880 00010000:00010000:1.0:1789265684.911407:0:25787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692400/0x9272d942b4a98789 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc48f expref: 37 pid: 22759 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265684.911440:0:25787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:1.0:1789265684.911451:0:25787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaea75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+37:2395:x1876180399723008:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265684.911468:0:25787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265684.911475:0:25787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a986cc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc457 expref: 37 pid: 25384 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.911504:0:25787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a986cc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc457 expref: 37 pid: 25384 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.911532:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491000/0x9272d942b4a986cc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc457 expref: 37 pid: 25384 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.911555:0:25787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:1.0:1789265684.911560:0:25787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.911570:0:25787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.911578:0:25787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265684.911655:0:25787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaea75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+36:2395:x1876180399723008:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 205us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265684.911664:0:25787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:1.0:1789265684.911719:0:25787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:1.0:1789265684.911726:0:25787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+35:2395:x1876180399722880:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789265684.911733:0:25787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789265684.911739:0:25787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692400/0x9272d942b4a98789 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc48f expref: 35 pid: 22759 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.911749:0:25787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692400/0x9272d942b4a98789 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc48f expref: 35 pid: 22759 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.911773:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692400/0x9272d942b4a98789 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc48f expref: 35 pid: 22759 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.911784:0:25787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:1.0:1789265684.911788:0:25787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.911796:0:25787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.911805:0:25787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.911835:0:25787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789265684.911868:0:25787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+34:2395:x1876180399722880:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 142us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265684.911875:0:25787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 18 00010000:00010000:1.0:1789265684.912369:0:22759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.912379:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265684.912404:0:22759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1789265684.912581:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692a00/0x9272d942b4a9879e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc49d expref: 35 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.912912:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc49d expref: 34 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.912940:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:1.0:1789265684.912943:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789265684.912946:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81693e00, rc 0) 00000100:00100000:1.0:1789265684.913009:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+34:18817:x1876180399722752:12345-192.168.203.49@tcp:101:bash.0 Request processed in 19207us (19482us total) trans 12884901912 rc 0/0 00000100:00100000:1.0:1789265684.913017:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 50 00000100:00100000:2.0:1789265684.917321:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265684.917505:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399723264 00000100:00100000:3.0:1789265684.917519:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399723264 00000100:00100000:3.0:1789265684.917588:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 51 00000100:00100000:3.0:1789265684.917726:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+34:18817:x1876180399723264:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:3.0:1789265684.918264:0:25384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a987b3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265684.918289:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a987b3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265684.918303:0:25384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a987b3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789265684.918350:0:25384:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:3.0:1789265684.918371:0:25384:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d68fd6e reply state 000000003b179991 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a987b3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265684.918385:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a987b3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265684.918394:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:3.0:1789265684.918397:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789265684.918401:0:25384:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789265684.918521:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+37:18817:x1876180399723264:12345-192.168.203.49@tcp:36:bash.0 Request processed in 795us (1212us total) trans 12884901914 rc 0/0 00000100:00100000:3.0:1789265684.919433:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 51 00000020:00080000:3.0:1789265684.919443:0:25384:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789265684.921054:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265684.921142:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399723392 00000100:00100000:1.0:1789265684.921154:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399723392 00000100:00100000:1.0:1789265684.921213:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 52 00000100:00100000:1.0:1789265684.921223:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+37:18817:x1876180399723392:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1789265684.921252:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265684.921277:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7600/0x9272d942b4a987ba lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc4a4 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.921348:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7600/0x9272d942b4a987ba lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4a4 expref: 38 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.921370:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7600/0x9272d942b4a987ba lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4a4 expref: 38 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.921390:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:1.0:1789265684.921394:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265684.921399:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb71c7600, rc 0) 00000100:00100000:1.0:1789265684.921469:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+38:18817:x1876180399723392:12345-192.168.203.49@tcp:101:bash.0 Request processed in 247us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265684.921496:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 52 00000100:00100000:0.0:1789265684.930523:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265684.930987:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399723520 00000100:00100000:1.0:1789265684.931002:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399723520 00000100:00100000:1.0:1789265684.932495:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 53 00000100:00100000:1.0:1789265684.932521:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+38:18817:x1876180399723520:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1789265684.932548:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265684.932578:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6a00/0x9272d942b4a987c1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc4ab expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.932721:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987c8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.932739:0:22760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc49d expref: 39 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.932749:0:22760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987c8 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.932794:0:22760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc49d expref: 39 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.932811:0:22760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc49d expref: 39 pid: 22759 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265684.932827:0:22760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bc2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22760:1876180417650816:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265684.932957:0:22760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c27f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265684.937659:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265684.937732:0:25787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399723648 00000100:00100000:3.0:1789265684.937745:0:25787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399723648 00010000:00010000:3.0:1789265684.937809:0:25787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc49d expref: 40 pid: 22759 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265684.937858:0:25787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:3.0:1789265684.937870:0:25787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82869500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+40:2395:x1876180399723648:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265684.937918:0:25787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265684.937927:0:25787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc49d expref: 40 pid: 22759 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265684.937943:0:25787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc49d expref: 40 pid: 22759 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265684.937981:0:25787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:3.0:1789265684.937989:0:25787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987c8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265684.938001:0:25787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265684.938010:0:25787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987c8 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265684.938071:0:25787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789265684.938088:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987a5 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc49d expref: 40 pid: 22759 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265684.938114:0:22760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bc2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22760:1876180417650816:192.168.203.49@tcp:104: 00000100:00100000:3.0:1789265684.938128:0:25787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82869500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+39:2395:x1876180399723648:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 261us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265684.938135:0:25787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 19 00010000:00010000:1.0:1789265684.938149:0:22760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.938158:0:22760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.938366:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265684.938438:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789265684.938443:0:22760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789265684.938469:0:22760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.938509:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6a00/0x9272d942b4a987c1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4ab expref: 39 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.938525:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987c8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4ab expref: 38 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.938533:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:1.0:1789265684.938535:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789265684.938538:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb71c7000, rc 0) 00000100:00100000:1.0:1789265684.938568:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+38:18817:x1876180399723520:12345-192.168.203.49@tcp:101:bash.0 Request processed in 6060us (8056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265684.938575:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 53 00000100:00100000:2.0:1789265684.941733:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265684.942208:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399723904 00000100:00100000:3.0:1789265684.942222:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399723904 00000100:00100000:3.0:1789265684.942311:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:3.0:1789265684.942323:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb82868380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+38:18817:x1876180399723904:12345-192.168.203.49@tcp:103:bash.0 00010000:00010000:3.0:1789265684.942343:0:22745:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789265684.942373:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7600/0x9272d942b4a987ba lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4a4 expref: 38 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265684.942420:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987c8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4ab expref: 37 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265684.942431:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:3.0:1789265684.942436:0:22745:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265684.942504:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb82868380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+36:18817:x1876180399723904:12345-192.168.203.49@tcp:103:bash.0 Request processed in 184us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265684.942512:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:0.0:1789265684.945158:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265684.945424:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399724032 00000100:00100000:1.0:1789265684.945435:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399724032 00000100:00100000:1.0:1789265684.945502:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 54 00000100:00100000:1.0:1789265684.945512:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+36:18817:x1876180399724032:12345-192.168.203.49@tcp:58:bash.0 00010000:00010000:1.0:1789265684.945880:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a987cf lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.945903:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a987cf lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265684.945916:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a987cf lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789265684.947952:0:22759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789265684.947988:0:22759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1789265684.948757:0:22759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1789265684.948887:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+36:18817:x1876180399724032:12345-192.168.203.49@tcp:58:bash.0 Request processed in 3370us (3743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265684.948899:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 54 00000100:00100000:2.0:1789265684.951305:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265684.951401:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399724160 00000100:00100000:3.0:1789265684.951414:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399724160 00000100:00100000:3.0:1789265684.951490:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 55 00000100:00100000:3.0:1789265684.951503:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb8286aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+36:18817:x1876180399724160:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1789265684.951530:0:25384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265684.951557:0:25384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a987d6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc4b2 expref: -99 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265684.951634:0:25384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a987cf lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265684.951647:0:25384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a987d6 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4b2 expref: 37 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265684.951670:0:25384:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a987cf lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265684.951686:0:25384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a987d6 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4b2 expref: 37 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265684.951724:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:3.0:1789265684.951728:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789265684.951733:0:25384:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a987d6 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4b2 expref: 37 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265684.951741:0:25384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7a00, rc 0) 00000100:00100000:3.0:1789265684.951815:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb8286aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+37:18817:x1876180399724160:12345-192.168.203.49@tcp:101:bash.0 Request processed in 315us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265684.951822:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 55 00010000:00010000:3.0:1789265685.377930:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789265685.701106:0:22793:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789265685.701121:0:22793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789265685.701550:0:22793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789265685.701563:0:22793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1789265685.701765:0:22793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bc2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22793:1876180417650944:192.168.203.49@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789265685.702077:0:22793:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83c27d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789265685.708924:0:22793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bc2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22793:1876180417650944:192.168.203.49@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789265685.718097:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265685.718531:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399724288 00000100:00100000:2.0:1789265685.718545:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399724288 00000100:00100000:2.0:1789265685.718633:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 56 00000100:00100000:2.0:1789265685.718645:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+37:18818:x1876180399724288:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789265685.718686:0:22761:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789265685.718855:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+37:18818:x1876180399724288:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 Request processed in 212us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265685.718864:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 56 00000100:00100000:2.0:1789265685.735580:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265685.736844:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399724416 00000100:00100000:1.0:1789265685.736862:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399724416 00000100:00100000:1.0:1789265685.736961:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 57 00000100:00100000:1.0:1789265685.736995:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+37:18818:x1876180399724416:12345-192.168.203.49@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789265685.737414:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a987dd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.737436:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a987dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.737450:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a987dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.737884:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a987e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.737908:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a987e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.737921:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a987e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.737965:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987eb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.737974:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.737980:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265685.738082:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789265685.738086:0:22760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265685.738105:0:22760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738116:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a987dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738148:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a987dd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738154:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a987dd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738160:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81693800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265685.738164:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a987dd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738170:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a987dd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738183:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fcc83bd4f00) 00010000:00010000:0.0:1789265685.738186:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265685.738190:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a987dd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738196:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a987dd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738210:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a987e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738216:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a987e4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738221:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a987e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738225:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81692800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265685.738234:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a987e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738240:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a987e4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738248:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9fcca9677600) 00010000:00010000:0.0:1789265685.738250:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265685.738253:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a987e4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738257:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a987e4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738272:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738277:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987eb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738283:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987eb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738287:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81693e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265685.738290:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987eb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738295:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987eb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738301:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:0.0:1789265685.738303:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265685.738312:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987eb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.738329:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a987eb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265685.738437:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+37:18818:x1876180399724416:12345-192.168.203.49@tcp:34:lhsmtool_posix.0 Request processed in 1441us (2868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265685.738447:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 57 00000100:00100000:2.0:1789265685.747883:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265685.751628:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399724672 00000100:00100000:1.0:1789265685.751652:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399724672 00000100:00100000:1.0:1789265685.751764:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 58 00000100:00100000:1.0:1789265685.751778:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+37:18818:x1876180399724672:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265685.751818:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265685.751849:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6a00/0x9272d942b4a987f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc4b9 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265685.752001:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987f9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265685.752195:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265685.752213:0:22761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265685.752228:0:22761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789265685.760435:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.760459:0:22761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987f9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.760468:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987f9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.760476:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c7000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265685.760482:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987f9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.760491:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987f9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.760514:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:0.0:1789265685.760517:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789265685.760523:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987f9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.760530:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7000/0x9272d942b4a987f9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.760642:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6a00/0x9272d942b4a987f2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4b9 expref: 39 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.760655:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fcc83bd4f00) 00010000:00010000:0.0:1789265685.760658:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789265685.760662:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6a00/0x9272d942b4a987f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4b9 expref: 39 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.760672:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb71c6a00, rc 0) 00000100:00100000:0.0:1789265685.760782:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+38:18818:x1876180399724672:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 9006us (12912us total) trans 12884901915 rc 301/301 00000100:00100000:0.0:1789265685.761785:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 58 00000100:00100000:2.0:1789265685.777434:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265685.777839:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399724800 00000100:00100000:3.0:1789265685.777863:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399724800 00000100:00100000:3.0:1789265685.777948:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00100000:3.0:1789265685.777969:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+38:18818:x1876180399724800:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789265685.778017:0:25384:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789265685.778225:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+38:18818:x1876180399724800:12345-192.168.203.49@tcp:53:lhsmtool_posix.0 Request processed in 257us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265685.778234:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00100000:2.0:1789265685.796979:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265685.797959:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399725056 00000100:00100000:3.0:1789265685.797978:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399725056 00000100:00100000:3.0:1789265685.798089:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 60 00000100:00100000:3.0:1789265685.798102:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+38:18818:x1876180399725056:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265685.798148:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265685.798176:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a98807 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc4c0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789265685.799095:0:22759:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:3.0:1789265685.799107:0:22759:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:3.0:1789265685.799137:0:22759:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:3.0:1789265685.799335:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a9880e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.799354:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a9880e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.799371:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a9880e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.799447:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a98807 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4c0 expref: 41 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.799468:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a9880e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4c0 expref: 40 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.799478:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fcc83bd4a00) 00010000:00010000:3.0:1789265685.799481:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789265685.799486:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b6000, rc 0) 00000100:00100000:3.0:1789265685.799579:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+40:18818:x1876180399725056:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 1479us (2617us total) trans 12884901916 rc 0/0 00000100:00100000:3.0:1789265685.799599:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 60 00000100:00100000:2.0:1789265685.808760:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265685.809167:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399725312 00000100:00100000:3.0:1789265685.809181:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399725312 00000100:00100000:3.0:1789265685.809262:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 61 00000100:00100000:3.0:1789265685.809274:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+40:18818:x1876180399725312:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265685.809373:0:25384:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265685.809409:0:25384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a9880e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4c0 expref: 40 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809433:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fcc83bd4a00) 00010000:00010000:3.0:1789265685.809445:0:25384:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789265685.809477:0:25384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a9881c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809494:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a9881c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809505:0:25384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a9881c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809521:0:25384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a98823 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x74e28c8c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809527:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a98823 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x74e28c8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809533:0:25384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a98823 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x74e28c8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809610:0:25384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a9881c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809617:0:25384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a9881c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809623:0:25384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a9881c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809645:0:25384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7c00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265685.809651:0:25384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a9881c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809668:0:25384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a9881c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809678:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fcc83bd4600) 00010000:00010000:3.0:1789265685.809681:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265685.809686:0:25384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a9881c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809692:0:25384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a9881c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809703:0:25384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a98823 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x74e28c8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809709:0:25384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a98823 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x74e28c8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809716:0:25384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a98823 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x74e28c8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809722:0:25384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265685.809724:0:25384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a98823 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x74e28c8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809731:0:25384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a98823 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x74e28c8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809749:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x74e28c8c (ffff9fcc83bd4e00) 00010000:00010000:3.0:1789265685.809752:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789265685.809755:0:25384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a98823 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x74e28c8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.809762:0:25384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a98823 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x74e28c8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265685.809883:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+39:18818:x1876180399725312:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 611us (1139us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789265685.809891:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 61 00000100:00100000:2.0:1789265685.827383:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265685.828764:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399725440 00000100:00100000:3.0:1789265685.828782:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399725440 00000100:00100000:3.0:1789265685.828892:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 62 00000100:00100000:3.0:1789265685.828905:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+39:18818:x1876180399725440:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789265685.828932:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789265685.828963:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a9882a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc4c7 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.829009:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a98831 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.829069:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a98831 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.829084:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a98831 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265685.829962:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6e00/0x9272d942b4a9882a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4c7 expref: 41 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265685.830005:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7c00/0x9272d942b4a98831 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4c7 expref: 40 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265685.830017:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fcc83bd4e00) 00010000:00010000:2.0:1789265685.830068:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789265685.830073:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc882b7c00, rc 0) 00000100:00100000:2.0:1789265685.830995:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+40:18818:x1876180399725440:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 2085us (3620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265685.831008:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 62 00000100:00100000:2.0:1789265685.848763:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265685.849977:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399725696 00000100:00100000:3.0:1789265685.850016:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399725696 00000100:00100000:3.0:1789265685.850167:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 63 00000100:00100000:3.0:1789265685.850180:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+40:18818:x1876180399725696:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789265685.850289:0:25384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a98838 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.850310:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a98838 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.850324:0:25384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a98838 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789265685.850573:0:25384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1789265685.850604:0:25384:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737080580546ns, next at 738080576283ns, rc = 0 00000004:00010000:0.0:1789265685.853536:0:25384:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001eff3205 reply state 00000000424ee3b5 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a98838 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.854292:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a98838 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.854304:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fcc83bd4e00) 00010000:00010000:0.0:1789265685.854308:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789265685.854313:0:25384:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789265685.854545:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+42:18818:x1876180399725696:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 4361us (5791us total) trans 12884901917 rc 0/0 00000100:00100000:0.0:1789265685.854563:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 63 00000100:00100000:1.0:1789265685.858898:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265685.859075:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399725824 00000100:00100000:0.0:1789265685.859089:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399725824 00000100:00100000:0.0:1789265685.859193:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 64 00000100:00100000:0.0:1789265685.859206:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb7bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+42:18818:x1876180399725824:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265685.859261:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265685.859291:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9883f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc4ce expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.859371:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9883f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4ce expref: 43 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.859389:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9883f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4ce expref: 43 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.859413:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fcc83bd4e00) 00010000:00010000:0.0:1789265685.859416:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789265685.859421:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81693e00, rc 0) 00000100:00100000:0.0:1789265685.859510:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb7bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+43:18818:x1876180399725824:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 306us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265685.859519:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 64 00000100:00100000:2.0:1789265685.864627:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265685.865374:0:24771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399725952 00000100:00100000:3.0:1789265685.865389:0:24771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399725952 00000100:00100000:3.0:1789265685.865494:0:24771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:3.0:1789265685.865507:0:24771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+5:2395:x1876180399725952:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789265685.867058:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265685.867606:0:24771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+6:2395:x1876180399725952:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 Request processed in 2071us (2963us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1789265685.867621:0:24771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:3.0:1789265685.874192:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265685.874379:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399726208 00000100:00100000:1.0:1789265685.874392:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399726208 00000100:00100000:1.0:1789265685.874467:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00100000:1.0:1789265685.874479:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+43:18818:x1876180399726208:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789265685.874808:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+44:18818:x1876180399726208:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 Request processed in 330us (629us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1789265685.874818:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00100000:1.0:1789265685.878889:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265685.886259:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399726464 00000100:00100000:0.0:1789265685.886283:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399726464 00000100:00100000:1.0:1789265685.892813:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 65 00000100:00100000:1.0:1789265685.892834:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb7bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+44:18818:x1876180399726464:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789265685.893008:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb7bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+44:18818:x1876180399726464:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 180us (14138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265685.893017:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 65 00000100:00100000:2.0:1789265685.897902:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265685.898104:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399726592 00000100:00100000:0.0:1789265685.898117:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399726592 00000100:00100000:0.0:1789265685.898208:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 66 00000100:00100000:0.0:1789265685.898220:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+44:18818:x1876180399726592:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789265685.898246:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789265685.898274:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a98846 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc4d5 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.898368:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a9884d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.898401:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a9884d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.898415:0:22761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a9884d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789265685.898475:0:22761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789265685.898499:0:22761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a9884d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.898532:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a98846 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4d5 expref: 46 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.898565:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a9884d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4d5 expref: 45 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.898574:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fcc83bd4e00) 00010000:00010000:0.0:1789265685.898577:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789265685.898581:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81693800, rc 0) 00000100:00100000:0.0:1789265685.898965:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+45:18818:x1876180399726592:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 744us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265685.898974:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 66 00000100:00100000:3.0:1789265685.904302:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265685.904435:0:25154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399726720 00000100:00100000:2.0:1789265685.904451:0:25154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399726720 00000100:00100000:2.0:1789265685.904531:0:25154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 22 00000100:00100000:2.0:1789265685.904544:0:25154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb814b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0c77789-04ce-4c79-87b2-012b259e18c5+6:2396:x1876180399726720:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789265685.904582:0:25154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265685.904626:0:25154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000321412ed/0x9272d942b4a98854 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc4dc expref: -99 pid: 25154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265685.904667:0:25154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa60716, blocks: 0x0 00010000:00010000:2.0:1789265685.904694:0:25154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=737s v=(0 0) 00010000:00010000:2.0:1789265685.904700:0:25154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265685.904712:0:25154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000321412ed/0x9272d942b4a98854 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4dc expref: 7 pid: 25154 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265685.904752:0:25154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000321412ed/0x9272d942b4a98854 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4dc expref: 7 pid: 25154 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265685.904768:0:25154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81491800, rc 0) 00000100:00100000:2.0:1789265685.904859:0:25154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb814b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0c77789-04ce-4c79-87b2-012b259e18c5+7:2396:x1876180399726720:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 317us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265685.904866:0:25154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 22 00000100:00100000:1.0:1789265685.918470:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265685.918622:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399726976 00000100:00100000:2.0:1789265685.918643:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399726976 00000100:00100000:2.0:1789265685.918723:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 67 00000100:00100000:2.0:1789265685.918735:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb7bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+45:18818:x1876180399726976:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789265685.918883:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb7bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+45:18818:x1876180399726976:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 149us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265685.918892:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 67 00000100:00100000:3.0:1789265685.933659:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265685.934081:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399727104 00000100:00100000:2.0:1789265685.934096:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399727104 00000100:00100000:2.0:1789265685.934376:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 68 00000100:00100000:2.0:1789265685.934389:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+45:18818:x1876180399727104:12345-192.168.203.49@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789265685.941565:0:22739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:2.0:1789265685.941606:0:22739:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789265685.941878:0:22739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:2.0:1789265685.942118:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+20:18818:x1876180399727104:12345-192.168.203.49@tcp:44:lhsmtool_posix.0 Request processed in 7724us (8466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265685.942305:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 68 00000100:00100000:1.0:1789265685.943467:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789265685.943496:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417651072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789265685.943771:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789265685.945114:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98616 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945270:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98616 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945281:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98616 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945307:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265685.945313:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98616 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945322:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98616 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945342:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fcc83bd4c00) 00010000:00010000:0.0:1789265685.945346:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265685.945351:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98616 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945359:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7200/0x9272d942b4a98616 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945389:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a9861d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945396:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a9861d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945402:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a9861d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945407:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265685.945410:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a9861d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945415:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a9861d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945434:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fcc83bd4600) 00010000:00010000:0.0:1789265685.945436:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265685.945440:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a9861d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945446:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7600/0x9272d942b4a9861d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945461:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a986c5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945467:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a986c5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945473:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a986c5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945478:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81490e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265685.945481:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a986c5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945488:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a986c5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945495:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9fcb83b85100) 00010000:00010000:0.0:1789265685.945497:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265685.945501:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a986c5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945507:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490e00/0x9272d942b4a986c5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945534:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6800/0x9272d942b4a9874a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.945540:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6800/0x9272d942b4a9874a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947043:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6800/0x9272d942b4a9874a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947071:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c6800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265685.947078:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6800/0x9272d942b4a9874a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947090:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6800/0x9272d942b4a9874a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947112:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:0.0:1789265685.947115:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265685.947121:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6800/0x9272d942b4a9874a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947274:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6800/0x9272d942b4a9874a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947313:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a9876d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947320:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a9876d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947327:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a9876d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947353:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81491e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265685.947356:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a9876d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947362:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a9876d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947372:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:0.0:1789265685.947375:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265685.947378:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a9876d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947384:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81491e00/0x9272d942b4a9876d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947398:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a987b3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947405:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a987b3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947410:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a987b3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947416:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b7800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265685.947419:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a987b3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947425:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a987b3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947444:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:0.0:1789265685.947447:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789265685.947449:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a987b3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947456:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7800/0x9272d942b4a987b3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947469:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a98838 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947476:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a98838 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947482:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a98838 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947487:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6000 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:0.0:1789265685.947490:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a98838 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947497:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a98838 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947505:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fcc83bd4e00) 00010000:00010000:0.0:1789265685.947508:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789265685.947511:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a98838 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.947517:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6000/0x9272d942b4a98838 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265685.948308:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417651072 00000100:00100000:2.0:1789265685.948325:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417651072 00000100:00100000:2.0:1789265685.948427:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265685.948439:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb7bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876180417651072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789265685.948861:0:24265:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789265685.948865:0:24265:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789265685.948867:0:24265:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789265685.948870:0:24265:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789265686 -> 1789265686 00002000:00010000:2.0:1789265685.948872:0:24265:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789265685.948979:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb7bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876180417651072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 543us (5208us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1789265685.948989:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:2.0:1789265685.949096:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fccb7bc0e00/2, rc 0, transno 12884901892 00000100:00100000:2.0:1789265685.949103:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876180417651072:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1789265685.950001:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789265685.950794:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9866a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.950813:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9866a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.950854:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9866a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.950862:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:3.0:1789265685.950868:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9866a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.950877:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9866a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.950896:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fcc83bd4600) 00010000:00010000:3.0:1789265685.950899:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789265685.950905:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9866a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265685.950911:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b6800/0x9272d942b4a9866a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265685.956873:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265685.957120:0:24771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399727232 00000100:00100000:1.0:1789265685.957149:0:24771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399727232 00000100:00100000:1.0:1789265685.957227:0:24771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:1.0:1789265685.957242:0:24771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+7:2394:x1876180399727232:12345-192.168.203.49@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789265685.957386:0:24771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+7:2394:x1876180399727232:12345-192.168.203.49@tcp:16:lhsmtool_posix.0 Request processed in 147us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265685.957394:0:24771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:1.0:1789265685.962377:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265685.962497:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399727488 00000100:00100000:2.0:1789265685.962510:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399727488 00000100:00100000:2.0:1789265685.962618:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 69 00000100:00100000:2.0:1789265685.962640:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb7bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+14:18818:x1876180399727488:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789265685.962719:0:22760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789265685.962754:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693800/0x9272d942b4a9884d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4d5 expref: 14 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265685.962778:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fcc83bd4e00) 00010000:00010000:2.0:1789265685.962784:0:22760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789265685.962826:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a9885b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265685.962852:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a9885b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265685.962883:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a9885b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789265685.963104:0:22760:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006569749d reply state 0000000080217093 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a9885b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265685.963117:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490000/0x9272d942b4a9885b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265685.963123:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fcc83bd4e00) 00010000:00010000:2.0:1789265685.963126:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789265685.963128:0:22760:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789265685.963268:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb7bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+15:18818:x1876180399727488:12345-192.168.203.49@tcp:36:lhsmtool_posix.0 Request processed in 639us (903us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1789265685.963277:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 69 00000100:00100000:3.0:1789265685.974853:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265685.975104:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399727616 00000100:00100000:1.0:1789265685.975119:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399727616 00000100:00100000:1.0:1789265685.975327:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 25 00000100:00100000:1.0:1789265685.975343:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+7:18818:x1876180399727616:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789265685.975367:0:24266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265685.975393:0:24266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a98862 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc4e3 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265685.975438:0:24266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000321412ed/0x9272d942b4a98854 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4dc expref: 8 pid: 25154 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265685.975467:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265685.975472:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789265685.975478:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a98862 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4e3 expref: 8 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265685.975525:0:24266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000321412ed/0x9272d942b4a98854 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4dc expref: 8 pid: 25154 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265685.975541:0:24266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000321412ed/0x9272d942b4a98854 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4dc expref: 8 pid: 25154 timeout: 837 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265685.975567:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24266:1876180417651200:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265685.976344:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd377f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789265685.984392:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265685.985288:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399727744 00000100:00100000:0.0:1789265685.985305:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399727744 00010000:00010000:0.0:1789265685.985369:0:22746:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000321412ed/0x9272d942b4a98854 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4dc expref: 9 pid: 25154 timeout: 837 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265685.985426:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:0.0:1789265685.985439:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+9:2396:x1876180399727744:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265685.985458:0:22746:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265685.985485:0:22746:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000321412ed/0x9272d942b4a98854 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4dc expref: 9 pid: 25154 timeout: 837 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.985502:0:22746:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000321412ed/0x9272d942b4a98854 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4dc expref: 9 pid: 25154 timeout: 837 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.985537:0:22746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265685.985542:0:22746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789265685.985563:0:22746:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a98862 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4e3 expref: 9 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.985575:0:22746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a98862 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4e3 expref: 9 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265685.985993:0:22746:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a98862 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4e3 expref: 9 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265685.986061:0:22746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83b91c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:22746:1876180417651328:192.168.203.49@tcp:105: 00000100:00100000:0.0:1789265685.986184:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83275a80 going to sleep for 11 seconds 00010000:00010000:1.0:1789265685.986445:0:24266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000321412ed/0x9272d942b4a98854 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4dc expref: 9 pid: 25154 timeout: 837 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265685.986465:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24266:1876180417651200:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265685.986496:0:24266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a98862 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4e3 expref: 8 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265685.986510:0:24266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb71c7800, rc 0) 00000100:00100000:1.0:1789265685.986558:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+8:18818:x1876180399727616:12345-192.168.203.49@tcp:101:lhsmtool_posix.0 Request processed in 11208us (11711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265685.986581:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 25 00000100:00100000:0.0:1789265685.990811:0:22746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83b91c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:22746:1876180417651328:192.168.203.49@tcp:105: 00010000:00010000:0.0:1789265685.990851:0:22746:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265685.990933:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+7:2396:x1876180399727744:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 5494us (6554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265685.990946:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:3.0:1789265685.991841:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265685.992381:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399727872 00000100:00100000:2.0:1789265685.992392:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399727872 00000100:00100000:2.0:1789265685.992463:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 26 00000100:00100000:2.0:1789265685.992475:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+7:2395:x1876180399727872:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789265685.992942:0:24264:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789265685.992947:0:24264:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789265685 00002000:00010000:2.0:1789265685.992949:0:24264:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789265683 00002000:00010000:2.0:1789265685.992952:0:24264:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789265686 -> 1789265685 00002000:00010000:2.0:1789265685.992955:0:24264:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789265685.994901:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+8:2395:x1876180399727872:12345-192.168.203.49@tcp:2:lhsmtool_posix.0 Request processed in 656us (1291us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1789265685.994946:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 26 00000100:00100000:3.0:1789265686.017618:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265686.017961:0:25154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399728000 00000100:00100000:3.0:1789265686.017971:0:25154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399728000 00000100:00100000:3.0:1789265686.018072:0:25154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 27 00000100:00100000:3.0:1789265686.018085:0:25154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0c77789-04ce-4c79-87b2-012b259e18c5+8:2395:x1876180399728000:12345-192.168.203.49@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789265686.018242:0:25154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000de66319c/0x9272d942b4a98869 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.018298:0:25154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a98862 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4e3 expref: 8 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.018308:0:25154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789265686.018313:0:25154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265686.018318:0:25154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de66319c/0x9272d942b4a98869 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.018357:0:25154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a98862 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4e3 expref: 8 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.018374:0:25154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a98862 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4e3 expref: 8 pid: 24266 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265686.018392:0:25154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf608380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25154:1876180417651584:192.168.203.49@tcp:104: 00000100:00100000:3.0:1789265686.018500:0:25154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb83cb4180 going to sleep for 11 seconds 00000100:00100000:0.0:1789265686.022639:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82fe313a-a4f8-4781-be1f-82c20160e337:3642:1876180417651712:0@lo:400:kworker.0 00000100:00100000:0.0:1789265686.022739:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265686.022793:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417652224:0@lo:400:kworker.0 00000100:00100000:0.0:1789265686.022833:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265686.022858:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417652736:0@lo:400:kworker.0 00000100:00100000:0.0:1789265686.022894:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265686.022931:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417652736 00000100:00100000:0.0:1789265686.022932:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417653248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789265686.022948:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417652736 00000100:00100000:0.0:1789265686.022967:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265686.023008:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1789265686.023072:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417651968:0@lo:400:kworker.0 00000100:00100000:1.0:1789265686.023153:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789265686.023169:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417652736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265686.023280:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876180417652736:12345-0@lo:400:kworker.0 Request processed in 116us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265686.023290:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789265686.025668:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417651456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265686.025837:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265686.025950:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417652096:0@lo:400:kworker.0 00000100:00100000:0.0:1789265686.025977:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265686.026011:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417652608:0@lo:400:kworker.0 00000100:00100000:0.0:1789265686.026070:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265686.026098:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417653120:0@lo:400:kworker.0 00000100:00100000:0.0:1789265686.026126:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789265686.027425:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876180417652736:0@lo:400:kworker.0 00000100:00100000:1.0:1789265686.027567:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417652096 00000100:00100000:1.0:1789265686.027574:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417652096 00000100:00100000:1.0:1789265686.027629:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417652608 00000100:00100000:1.0:1789265686.027633:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417652608 00000100:00100000:1.0:1789265686.027645:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417653120 00000100:00100000:1.0:1789265686.027648:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417653120 00000100:00100000:1.0:1789265686.027669:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789265686.027678:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417652096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265686.027768:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876180417652096:12345-0@lo:400:kworker.0 Request processed in 90us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265686.027775:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789265686.027793:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265686.027799:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb7bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417652608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265686.027827:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb7bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876180417652608:12345-0@lo:400:kworker.0 Request processed in 29us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265686.027833:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789265686.027844:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789265686.027850:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb7bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417653120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265686.027894:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb7bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876180417653120:12345-0@lo:400:kworker.0 Request processed in 45us (1768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265686.027900:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789265686.031820:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417653248 00000100:00100000:3.0:1789265686.031835:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417653248 00000100:00100000:3.0:1789265686.031880:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417651456 00000100:00100000:3.0:1789265686.031884:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417651456 00000100:00100000:3.0:1789265686.031906:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789265686.031915:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417653248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789265686.031947:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789265686.032045:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876180417653248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (9077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265686.032070:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789265686.032088:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789265686.032095:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417651456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789265686.032111:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789265686.032139:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417651456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (6303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265686.032145:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789265686.032996:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265686.033458:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399728128 00000100:00100000:3.0:1789265686.033465:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399728128 00010000:00010000:3.0:1789265686.033494:0:22745:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a98862 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4e3 expref: 9 pid: 24266 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265686.033534:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:3.0:1789265686.033543:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+9:2395:x1876180399728128:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265686.033555:0:22745:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265686.033576:0:22745:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a98862 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4e3 expref: 9 pid: 24266 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.033602:0:22745:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a98862 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4e3 expref: 9 pid: 24266 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.033632:0:22745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265686.033636:0:22745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789265686.033642:0:22745:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000de66319c/0x9272d942b4a98869 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.033667:0:22745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de66319c/0x9272d942b4a98869 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.033688:0:22745:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265686.033850:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+9:2395:x1876180399728128:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 306us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265686.033858:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 21 00010000:00010000:3.0:1789265686.033903:0:25154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa4aba4/0x9272d942b4a98862 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4e3 expref: 8 pid: 24266 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265686.033920:0:25154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf608380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25154:1876180417651584:192.168.203.49@tcp:104: 00010000:00010000:3.0:1789265686.033939:0:25154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000de66319c/0x9272d942b4a98869 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.033948:0:25154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000de66319c/0x9272d942b4a98869 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.033956:0:25154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de66319c/0x9272d942b4a98869 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.033976:0:25154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000de66319c/0x9272d942b4a98869 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.033984:0:25154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de66319c/0x9272d942b4a98869 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.033999:0:25154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de66319c/0x9272d942b4a98869 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.034006:0:25154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc882b6600 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:3.0:1789265686.034010:0:25154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de66319c/0x9272d942b4a98869 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.034019:0:25154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de66319c/0x9272d942b4a98869 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.034072:0:25154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de66319c/0x9272d942b4a98869 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.034079:0:25154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de66319c/0x9272d942b4a98869 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265686.034127:0:25154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0c77789-04ce-4c79-87b2-012b259e18c5+7:2395:x1876180399728000:12345-192.168.203.49@tcp:1:lhsmtool_posix.0 Request processed in 16045us (16518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265686.034134:0:25154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 27 00000100:00100000:0.0:1789265686.034958:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417651456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789265686.034974:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876180417652096:0@lo:400:kworker.0 00000100:00100000:0.0:1789265686.034986:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876180417652608:0@lo:400:kworker.0 00010000:00080000:0.0:1789265686.034999:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fcb83e2d880 x1876180417653120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789265686.035008:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876180417653120:0@lo:400:kworker.0 00000100:00100000:0.0:1789265686.035046:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417653248:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789265686.035079:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789265686.035086:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265686.035089:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789265686.035178:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417651712 00000100:00100000:3.0:1789265686.035184:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417651712 00000100:00100000:3.0:1789265686.035266:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789265686.035275:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+24:3642:x1876180417651712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789265686.035335:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82fe313a-a4f8-4781-be1f-82c20160e337+24:3642:x1876180417651712:12345-0@lo:400:kworker.0 Request processed in 62us (12597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265686.035353:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789265686.035439:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82fe313a-a4f8-4781-be1f-82c20160e337:3642:1876180417651712:0@lo:400:kworker.0 00000100:00100000:2.0:1789265686.035445:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417652224 00000100:00100000:2.0:1789265686.035525:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417652224 00000100:00100000:2.0:1789265686.035610:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789265686.035620:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417652224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265686.035832:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876180417652224:12345-0@lo:400:kworker.0 Request processed in 213us (12997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265686.035841:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789265686.035852:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876180417652224:0@lo:400:kworker.0 00000100:00100000:2.0:1789265686.035921:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265686.035968:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417652480:0@lo:400:kworker.0 00000100:00100000:2.0:1789265686.035993:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265686.036011:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83e2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417652992:0@lo:400:kworker.0 00000100:00100000:2.0:1789265686.036084:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265686.036126:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1789265686.036135:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417651840:0@lo:400:kworker.0 00000100:00100000:2.0:1789265686.036160:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265686.037813:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417651840 00000100:00100000:2.0:1789265686.037826:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417651840 00000100:00100000:2.0:1789265686.037892:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789265686.037911:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417651840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265686.037983:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417651840:12345-0@lo:400:kworker.0 Request processed in 83us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265686.037992:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789265686.038068:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417651840:0@lo:400:kworker.0 00000100:00100000:2.0:1789265686.038099:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417652352:0@lo:400:kworker.0 00000100:00100000:2.0:1789265686.038135:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265686.038159:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417651968 00000100:00100000:2.0:1789265686.038163:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417651968 00000100:00100000:2.0:1789265686.038388:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417652480 00000100:00100000:2.0:1789265686.038393:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417652480 00000100:00100000:2.0:1789265686.038429:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417652352 00000100:00100000:2.0:1789265686.038432:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417652352 00000100:00100000:2.0:1789265686.038447:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265686.038453:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417651968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265686.038487:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876180417651968:12345-0@lo:400:kworker.0 Request processed in 35us (2568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265686.038493:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789265686.038503:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265686.038509:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417652480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265686.038531:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417652480:12345-0@lo:400:kworker.0 Request processed in 23us (2537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265686.038539:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789265686.038548:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265686.038552:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417652352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265686.038572:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417652352:12345-0@lo:400:kworker.0 Request processed in 20us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265686.038578:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789265686.038685:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417652352:0@lo:400:kworker.0 00000100:00100000:2.0:1789265686.039473:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417652864:0@lo:400:kworker.0 00000100:00100000:2.0:1789265686.039610:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265686.039675:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417653376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789265686.039706:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265686.039745:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417653376 00000100:00100000:2.0:1789265686.039750:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417653376 00000100:00100000:2.0:1789265686.039793:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265686.039802:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417653376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789265686.039825:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789265686.039870:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876180417653376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265686.039878:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789265686.039932:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417653376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789265686.039951:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417652992 00000100:00100000:2.0:1789265686.039954:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876180417651968:0@lo:400:kworker.0 00000100:00100000:1.0:1789265686.039969:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417652992 00000100:00100000:2.0:1789265686.039970:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876180417652480:0@lo:400:kworker.0 00000100:00100000:1.0:1789265686.040097:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417652864 00000100:00100000:1.0:1789265686.040103:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417652864 00000100:00100000:1.0:1789265686.040147:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789265686.040158:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417652992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789265686.040255:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876180417652992:12345-0@lo:400:kworker.0 Request processed in 99us (4169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265686.040263:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789265686.040287:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789265686.040299:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417652864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789265686.040322:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83e2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876180417652992:0@lo:400:kworker.0 00010000:00080000:2.0:1789265686.040355:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fccb7bc0000 x1876180417652864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789265702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789265686.040366:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876180417652864:0@lo:400:kworker.0 00000100:00080000:0.0:1789265686.041481:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789265686.041489:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789265686.041493:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789265686.041496:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789265686.044166:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876180417652864:12345-0@lo:400:kworker.0 Request processed in 3860us (4545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265686.044181:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789265686.044424:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265686.046937:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399728384 00000100:00100000:0.0:1789265686.046953:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399728384 00000100:00100000:0.0:1789265686.047125:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 70 00000100:00100000:0.0:1789265686.047136:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+15:18818:x1876180399728384:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789265686.047220:0:25384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a98870 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265686.047238:0:25384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98743 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc481 expref: 15 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265686.047262:0:25384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a98870 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265686.047297:0:25384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98743 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc481 expref: 15 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265686.047311:0:25384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98743 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc481 expref: 15 pid: 22759 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265686.047325:0:25384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bec700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25384:1876180417653504:192.168.203.49@tcp:104: 00000100:00100000:0.0:1789265686.047413:0:25384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcc83275a80 going to sleep for 11 seconds 00000100:00080000:2.0:1789265686.050580:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789265686.055254:0:25384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bec700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25384:1876180417653504:192.168.203.49@tcp:104: 00010000:00010000:0.0:1789265686.055287:0:25384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a98870 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789265686.065631:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265686.065727:0:25787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399728512 00000100:00100000:3.0:1789265686.065738:0:25787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399728512 00010000:00010000:3.0:1789265686.065780:0:25787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98743 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc481 expref: 16 pid: 22759 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265686.065826:0:25787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 22 00000100:00100000:3.0:1789265686.065836:0:25787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+16:2395:x1876180399728512:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789265686.065854:0:25787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789265686.065860:0:25787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98743 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc481 expref: 16 pid: 22759 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.065874:0:25787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98743 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc481 expref: 16 pid: 22759 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.065898:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81490600/0x9272d942b4a98743 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc481 expref: 16 pid: 22759 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.065916:0:25787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:3.0:1789265686.065922:0:25787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a987d6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4b2 expref: 15 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.065933:0:25787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a98870 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.065941:0:25787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a98870 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.065968:0:25787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a98870 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789265686.066007:0:25787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789265686.066115:0:25787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+15:2395:x1876180399728512:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 280us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265686.066124:0:25787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 22 00010000:00010000:1.0:1789265686.066312:0:25384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a98870 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.066323:0:25384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a98870 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.066540:0:25384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a98877 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.066557:0:25384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9883f lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4ce expref: 15 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.066565:0:25384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a98877 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.066601:0:25384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9883f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4ce expref: 15 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.066614:0:25384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9883f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4ce expref: 15 pid: 22761 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265686.066627:0:25384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25384:1876180417653632:192.168.203.49@tcp:104: 00000100:00100000:1.0:1789265686.066694:0:25384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fccbd377840 going to sleep for 11 seconds 00000100:00100000:1.0:1789265686.086856:0:25384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25384:1876180417653632:192.168.203.49@tcp:104: 00010000:00010000:1.0:1789265686.086888:0:25384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a98877 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789265686.087210:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265686.087302:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399728640 00000100:00100000:0.0:1789265686.087311:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399728640 00010000:00010000:0.0:1789265686.087350:0:22745:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9883f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4ce expref: 16 pid: 22761 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789265686.087394:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23 00000100:00100000:0.0:1789265686.087403:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccaea77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+16:2394:x1876180399728640:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789265686.087419:0:22745:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789265686.087425:0:22745:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9883f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4ce expref: 16 pid: 22761 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265686.087460:0:22745:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9883f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4ce expref: 16 pid: 22761 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265686.087483:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81693e00/0x9272d942b4a9883f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4ce expref: 16 pid: 22761 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265686.087500:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fcc83bd4e00) 00010000:00010000:0.0:1789265686.087506:0:22745:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a98877 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265686.087515:0:22745:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a98877 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265686.087522:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a98877 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789265686.087551:0:22745:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789265686.087616:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccaea77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+15:2394:x1876180399728640:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 213us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265686.087623:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23 00010000:00010000:2.0:1789265686.088196:0:25384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a98877 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265686.088205:0:25384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a98877 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789265686.088331:0:25384:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:2.0:1789265686.088450:0:25384:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1789265686.088486:0:25384:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:2.0:1789265686.088574:0:25384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25384:1876180417653760:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789265686.088634:0:25384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789265686.088674:0:25384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb822b9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789265686.088728:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417653760 00000100:00100000:0.0:1789265686.088734:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417653760 00000100:00100000:0.0:1789265686.088774:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789265686.088783:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:25384:x1876180417653760:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789265686.088875:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:25384:x1876180417653760:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265686.088882:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789265686.089015:0:25384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25384:1876180417653760:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789265686.089187:0:25384:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:1.0:1789265686.089226:0:25384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25384:1876180417653888:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789265686.089255:0:25384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265686.089284:0:25384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82dff480 going to sleep for 11 seconds 00000100:00100000:3.0:1789265686.089349:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417653888 00000100:00100000:3.0:1789265686.089354:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417653888 00000100:00100000:3.0:1789265686.089381:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789265686.089389:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcb83bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:25384:x1876180417653888:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789265686.089501:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcb83bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:25384:x1876180417653888:12345-0@lo:1000:mdt00_003.0 Request processed in 112us (244us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1789265686.089508:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789265686.089580:0:25384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25384:1876180417653888:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789265686.089619:0:25384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a98877 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.089634:0:25384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a98877 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.089640:0:25384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a98877 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.089647:0:25384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c7200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265686.089652:0:25384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a98877 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.089659:0:25384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a98877 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.089673:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fcc83bd4e00) 00010000:00010000:1.0:1789265686.089676:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265686.089680:0:25384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a98877 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.089686:0:25384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a98877 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.089714:0:25384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a987cf lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.089720:0:25384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a987cf lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.089725:0:25384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a987cf lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.089730:0:25384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c7e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265686.089739:0:25384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a987cf lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.089744:0:25384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a987cf lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.089753:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:1.0:1789265686.089756:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789265686.089762:0:25384:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a987d6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4b2 expref: 18 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.089772:0:25384:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a987d6 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4b2 expref: 18 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.089781:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a987d6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4b2 expref: 18 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.089832:0:25384:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc882b7a00/0x9272d942b4a987d6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4b2 expref: 18 pid: 25384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265686.089858:0:25384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25384:1876180417654016:192.168.203.49@tcp:105: 00000100:00100000:1.0:1789265686.089923:0:25384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fcb82dff000 going to sleep for 11 seconds 00000100:00100000:1.0:1789265686.098259:0:25384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25384:1876180417654016:192.168.203.49@tcp:105: 00010000:00010000:1.0:1789265686.098292:0:25384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a987cf lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098304:0:25384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a987cf lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098352:0:25384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a9887e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098367:0:25384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a9887e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098378:0:25384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a9887e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098387:0:25384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a9887e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098393:0:25384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a9887e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098399:0:25384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a9887e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098405:0:25384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c7200 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265686.098409:0:25384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a9887e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098415:0:25384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a9887e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098424:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:1.0:1789265686.098427:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265686.098431:0:25384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a9887e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098437:0:25384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a9887e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098453:0:25384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a98870 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098459:0:25384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a98870 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098466:0:25384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a98870 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098471:0:25384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fcc81692800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265686.098474:0:25384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a98870 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098479:0:25384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a98870 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098487:0:25384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:1.0:1789265686.098490:0:25384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265686.098493:0:25384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a98870 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.098499:0:25384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fcc81692800/0x9272d942b4a98870 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265686.098724:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+18:18818:x1876180399728384:12345-192.168.203.49@tcp:57:lhsmtool_posix.0 Request processed in 51588us (54301us total) trans 12884901924 rc 0/0 00000100:00100000:1.0:1789265686.098734:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 70 00000020:00080000:1.0:1789265686.098741:0:25384:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789265686.101422:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265686.102160:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399728768 00000100:00100000:1.0:1789265686.102171:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399728768 00000100:00100000:1.0:1789265686.102250:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:1.0:1789265686.102261:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+18:18817:x1876180399728768:12345-192.168.203.49@tcp:49:bash.0 00000100:00100000:1.0:1789265686.102382:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+18:18817:x1876180399728768:12345-192.168.203.49@tcp:49:bash.0 Request processed in 123us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265686.102391:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:3.0:1789265686.103283:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265686.103366:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399729024 00000100:00100000:1.0:1789265686.103371:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399729024 00000100:00100000:1.0:1789265686.103399:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:1.0:1789265686.103407:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+18:18818:x1876180399729024:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789265686.103666:0:22763:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789265686.103698:0:22763:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:1.0:1789265686.103745:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a98885 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.103762:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a98885 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.103774:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a98885 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.103783:0:22763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a98885 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.103789:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a98885 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.103795:0:22763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a98885 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.103811:0:22763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789265686.103897:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+20:18818:x1876180399729024:12345-192.168.203.49@tcp:35:lhsmtool_posix.0 Request processed in 489us (617us total) trans 12884901926 rc 0/0 00000100:00100000:1.0:1789265686.103903:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 13 00000020:00080000:1.0:1789265686.103908:0:22763:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789265686.103929:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789265686.103935:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a98885 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.103942:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c7800 already unused, calling callback (ffffffffc0b90350) 00010000:00010000:1.0:1789265686.103945:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a98885 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.103953:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a98885 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.103965:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fcc83bd4e00) 00010000:00010000:1.0:1789265686.103968:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789265686.103973:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a98885 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.103978:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a98885 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.103989:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265686.103990:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789265686.103992:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789265686.106991:0:22793:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789265686.107001:0:22793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789265686.107035:0:22793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789265686.107045:0:22793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1789265686.111928:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265686.116071:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399729152 00000100:00100000:2.0:1789265686.116086:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399729152 00000100:00100000:2.0:1789265686.116165:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 28 00000100:00100000:2.0:1789265686.116175:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+7:18817:x1876180399729152:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1789265686.116192:0:24264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789265686.116212:0:24264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb74d500/0x9272d942b4a9888c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc4ea expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789265686.116238:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aa60715, atime: 0x6aa60713, ctime: 0x6aa60715, blocks: 0x0 00010000:00010000:2.0:1789265686.116258:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=737s v=(0 0) 00010000:00010000:2.0:1789265686.116263:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789265686.116274:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb74d500/0x9272d942b4a9888c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4ea expref: 8 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265686.116292:0:24264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb74d500/0x9272d942b4a9888c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4ea expref: 8 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789265686.116323:0:24264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fcc81490400, rc 0) 00000100:00100000:2.0:1789265686.116384:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+8:18817:x1876180399729152:12345-192.168.203.49@tcp:101:bash.0 Request processed in 209us (4465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265686.116391:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 28 00000100:00100000:0.0:1789265686.125635:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265686.125763:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399729280 00000100:00100000:1.0:1789265686.125773:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399729280 00000100:00100000:1.0:1789265686.125842:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 71 00000100:00100000:1.0:1789265686.125854:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb7bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+20:18817:x1876180399729280:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1789265686.125878:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265686.125912:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a98893 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc4f1 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.125947:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a9889a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.125961:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a9889a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.125973:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a9889a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.126115:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a98893 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4f1 expref: 22 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.126453:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7200/0x9272d942b4a9889a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4f1 expref: 21 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.126464:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:1.0:1789265686.126467:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789265686.126470:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb71c7200, rc 0) 00000100:00100000:1.0:1789265686.126534:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb7bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+21:18817:x1876180399729280:12345-192.168.203.49@tcp:101:bash.0 Request processed in 683us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265686.126542:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 71 00000100:00100000:0.0:1789265686.132536:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265686.132621:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399729536 00000100:00100000:1.0:1789265686.132630:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399729536 00000100:00100000:1.0:1789265686.132692:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00100000:1.0:1789265686.132714:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb7bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+21:18817:x1876180399729536:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:1.0:1789265686.132963:0:22763:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:1.0:1789265686.133090:0:22763:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:1.0:1789265686.133187:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb7bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+24:18817:x1876180399729536:12345-192.168.203.49@tcp:35:bash.0 Request processed in 485us (659us total) trans 12884901929 rc 0/0 00000100:00100000:1.0:1789265686.133195:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 14 00000020:00080000:1.0:1789265686.133200:0:22763:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789265686.234437:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265686.234548:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399729792 00000100:00100000:1.0:1789265686.234564:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399729792 00000100:00100000:1.0:1789265686.234656:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 72 00000100:00100000:1.0:1789265686.234668:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+24:18829:x1876180399729792:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1789265686.234693:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789265686.234713:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a988a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x97379136ce8cc4f8 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789265686.234807:0:22761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789265686.234901:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a988a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4f8 expref: 26 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.234916:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fcc83bd4800) 00010000:00010000:1.0:1789265686.234932:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789265686.234938:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a988a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x97379136ce8cc4f8 expref: 26 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.234952:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fccb71c7800, rc 0) 00000100:00100000:1.0:1789265686.235072:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+25:18829:x1876180399729792:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 355us (595us total) trans 12884901930 rc 301/301 00000100:00100000:1.0:1789265686.235081:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 72 00000100:00100000:0.0:1789265686.241925:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265686.242049:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399729920 00000100:00100000:1.0:1789265686.242060:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399729920 00000100:00100000:1.0:1789265686.242136:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 73 00000100:00100000:1.0:1789265686.242146:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb7bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+25:18829:x1876180399729920:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:1.0:1789265686.242225:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a988af lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242241:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a988af lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242253:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a988af lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242269:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a988b6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242276:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a988b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242282:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a988b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242355:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6600/0x9272d942b4a988bd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242364:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6600/0x9272d942b4a988bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242371:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6600/0x9272d942b4a988bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789265686.242416:0:22760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6600/0x9272d942b4a988bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242429:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a988af lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242441:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a988af lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242448:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a988af lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242454:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c7800 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265686.242458:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a988af lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242465:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a988af lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242477:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fcc83bd4600) 00010000:00010000:1.0:1789265686.242480:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265686.242485:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a988af lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242491:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7800/0x9272d942b4a988af lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242505:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a988b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242512:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a988b6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242518:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a988b6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242523:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c7e00 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265686.242532:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a988b6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242540:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a988b6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242548:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9fccb94dfe00) 00010000:00010000:1.0:1789265686.242551:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265686.242554:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a988b6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242560:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c7e00/0x9272d942b4a988b6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242574:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6600/0x9272d942b4a988bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242580:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6600/0x9272d942b4a988bd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242601:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6600/0x9272d942b4a988bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242606:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fccb71c6600 already unused, calling callback (ffffffffc17a14f0) 00010000:00010000:1.0:1789265686.242609:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6600/0x9272d942b4a988bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242615:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6600/0x9272d942b4a988bd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242622:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fcb83b85c00) 00010000:00010000:1.0:1789265686.242624:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789265686.242635:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6600/0x9272d942b4a988bd lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789265686.242641:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fccb71c6600/0x9272d942b4a988bd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789265686.242722:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb7bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+25:18829:x1876180399729920:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 577us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265686.242731:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 73 00000100:00100000:0.0:1789265686.247695:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1789265686.248488:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399730176 00000100:00100000:1.0:1789265686.248499:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399730176 00000100:00100000:1.0:1789265686.248881:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00100000:1.0:1789265686.248893:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb7befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+25:18829:x1876180399730176:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:1.0:1789265686.249678:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb7befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c0c77789-04ce-4c79-87b2-012b259e18c5+26:18829:x1876180399730176:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 783us (1987us total) trans 12884901931 rc 0/0 00000100:00100000:1.0:1789265686.249688:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 15 00010000:00010000:3.0:1789265686.401499:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265687.378858:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265687.378904:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265687.378937:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265687.378971:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265687.379044:0:25154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399730816 00000100:00100000:0.0:1789265687.379053:0:25154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399730816 00000100:00100000:3.0:1789265687.379257:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265687.379285:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1789265687.380945:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399730304 00000100:00100000:2.0:1789265687.380957:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399730304 00000100:00100000:0.0:1789265687.380970:0:25154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399731328 00000100:00100000:0.0:1789265687.380976:0:25154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399731328 00000100:00100000:2.0:1789265687.381011:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 169 00000100:00100000:2.0:1789265687.381046:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fcc846ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:2394:x1876180399730304:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265687.381116:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fcc846ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e10fc26-9cb2-4fc3-a83c-10bb2defac1a+13:2394:x1876180399730304:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 95us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265687.381123:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 169 00000100:00080000:2.0:1789265687.381157:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789265687.381169:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 26 00000100:00100000:2.0:1789265687.381177:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+5:2394:x1876180399730816:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265687.381204:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+5:2394:x1876180399730816:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265687.381210:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 26 00000100:00100000:2.0:1789265687.381242:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 27 00000100:00100000:2.0:1789265687.381249:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2394:x1876180399731328:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265687.381272:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2394:x1876180399731328:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 24us (2016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265687.381278:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 27 00000100:00100000:1.0:1789265687.381996:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399730560 00000100:00100000:1.0:1789265687.382004:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399730560 00000100:00100000:1.0:1789265687.382075:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399731072 00000100:00100000:1.0:1789265687.382079:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399731072 00000100:00100000:1.0:1789265687.382102:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399730432 00000100:00100000:1.0:1789265687.382105:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399730432 00000100:00100000:1.0:1789265687.382123:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 76 00000100:00100000:1.0:1789265687.382132:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+5:2394:x1876180399730560:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265687.382172:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0c77789-04ce-4c79-87b2-012b259e18c5+5:2394:x1876180399730560:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 41us (3267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789265687.382181:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 76 00000100:00100000:1.0:1789265687.382198:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 77 00000100:00100000:2.0:1789265687.382211:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 78 00000100:00100000:1.0:1789265687.382211:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2394:x1876180399731072:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1789265687.382261:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2394:x1876180399731072:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 56us (3290us total) trans 0 rc 0/0 00000100:00080000:2.0:1789265687.382485:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789265687.382497:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+26:2394:x1876180399730432:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265687.382530:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0c77789-04ce-4c79-87b2-012b259e18c5+26:2394:x1876180399730432:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 49us (3245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265687.383666:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265687.383715:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265687.383736:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265687.383763:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399730688 00000100:00100000:3.0:1789265687.383770:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399730688 00000100:00100000:3.0:1789265687.383809:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399731200 00000100:00100000:3.0:1789265687.383813:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399731200 00000100:00100000:3.0:1789265687.383837:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 28 00000100:00100000:3.0:1789265687.383845:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf60aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+8:2394:x1876180399730688:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265687.383885:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf60aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+8:2394:x1876180399730688:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 41us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265687.383891:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 28 00000100:00100000:3.0:1789265687.383906:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00100000:3.0:1789265687.383912:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2394:x1876180399731200:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1789265687.383935:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fed7caf6-20fa-460c-bf48-65425dcf3952+5:2394:x1876180399731200:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265687.383942:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00080000:3.0:1789265687.384066:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789265687.384214:0:22759:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789265687.384222:0:22759:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1789265687.384337:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 77 00000100:00100000:2.0:1789265687.384470:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 78 00000100:00100000:2.0:1789265687.384490:0:25384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399730944 00000100:00100000:2.0:1789265687.384494:0:25384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399730944 00000100:00080000:2.0:1789265687.384514:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789265687.385300:0:25384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 79 00000100:00100000:2.0:1789265687.385311:0:25384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed7caf6-20fa-460c-bf48-65425dcf3952+6:2394:x1876180399730944:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1789265687.385620:0:25384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fed7caf6-20fa-460c-bf48-65425dcf3952+6:2394:x1876180399730944:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 311us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789265687.385627:0:25384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 79 00010000:00010000:1.0:1789265687.426471:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789265688.280483:0:25843:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1789265688.449836:0:22748:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789265688.904947:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1789265688.905082:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1789265688.905372:0:25154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399731584 00000100:00100000:0.0:1789265688.905383:0:25154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399731584 00000100:00100000:0.0:1789265688.905448:0:25154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00100000:0.0:1789265688.905458:0:25154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0c77789-04ce-4c79-87b2-012b259e18c5+8:2395:x1876180399731584:12345-192.168.203.49@tcp:16:kworker.0 00000100:00100000:0.0:1789265688.905595:0:25154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c0c77789-04ce-4c79-87b2-012b259e18c5+8:2395:x1876180399731584:12345-192.168.203.49@tcp:16:kworker.0 Request processed in 137us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265688.905604:0:25154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00100000:2.0:1789265688.905624:0:24269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180399731456 00000100:00100000:2.0:1789265688.905630:0:24269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180399731456 00002000:00100000:2.0:1789265688.905655:0:24269:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9fccbd3e7100 x1876180399731456/t0(0) o4->c0c77789-04ce-4c79-87b2-012b259e18c5@192.168.203.49@tcp:259/0 lens 504/0 e 0 to 0 dl 1789265699 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1789265688.905665:0:24269:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fccbd3e7100 with x1876180399731456 ext(0->8) 00002000:00010000:2.0:1789265688.905671:0:24269:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fccbd3e7100 00000100:00100000:2.0:1789265688.905704:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:2.0:1789265688.905711:0:24269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+8:2395:x1876180399731456:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:2.0:1789265688.908324:0:24269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c0c77789-04ce-4c79-87b2-012b259e18c5+10:2395:x1876180399731456:12345-192.168.203.49@tcp:4:bash.0 Request processed in 2604us (3233us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1789265688.908337:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 0 00002000:00100000:2.0:1789265688.908348:0:24269:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9fccbd3e7100 x1876180399731456/t12884901895(0) o4->c0c77789-04ce-4c79-87b2-012b259e18c5@192.168.203.49@tcp:259/0 lens 504/448 e 0 to 0 dl 1789265699 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1789265688.908366:0:24269:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fccbd3e7100 with x1876180399731456 ext(0->8) 00002000:00010000:2.0:1789265688.908372:0:24269:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fccbd3e7100 00000100:00100000:3.0:1789265689.089704:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789265689.089726:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fcb83bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417654144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789265689.089792:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789265689.089910:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789265689.089920:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccb7bc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417654272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789265689.089952:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789265689.090065:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417654272 00000100:00100000:3.0:1789265689.090072:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417654272 00000100:00100000:3.0:1789265689.090117:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789265689.090124:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccb7bc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417654272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789265689.090154:0:22765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789265689.090196:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccb7bc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876180417654272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789265689.090203:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789265689.090242:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccb7bc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876180417654272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789265689.090494:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417654144 00000100:00100000:0.0:1789265689.090499:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417654144 00000100:00100000:0.0:1789265689.090693:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789265689.090702:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbd3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417654144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789265689.090714:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789265689.090754:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbd3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876180417654144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265689.090760:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789265689.090793:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fcb83bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876180417654144:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789265689.090860:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789265689.091007:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fccbf40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417654400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789265689.091060:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789265689.091065:0:22755:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789265689.091113:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876180417654400 00000100:00100000:0.0:1789265689.091118:0:23784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876180417654400 00000100:00100000:0.0:1789265689.091186:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789265689.091193:0:23784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fccbf40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417654400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789265689.091213:0:23784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1789265689.091255:0:23784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fccbf40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876180417654400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789265689.091262:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789265689.091317:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fccbf40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876180417654400:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789265689.474927:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789265689.922579:0:23512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 Debug log: 14639 lines, 14639 kept, 0 dropped, 0 bad.