00010000:00010000:3.0F:1788581521.989128:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581522.754283:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581522.754508:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184265600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788581522.754682:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581522.754777:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184265600 00000100:00100000:3.0:1788581522.754787:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184265600 00000100:00100000:3.0:1788581522.756947:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788581522.756981:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184265600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788581522.757030:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788581522.757134:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184265600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 172us (2452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581522.757142:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788581522.757175:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581522.760005:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184265600:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0F:1788581522.763552:0:17043:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:1.0:1788581522.763589:0:17043:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff995e4e9f7d80 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1788581522.763593:0:17043:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995e7b00bd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff995e4e9f7000 00000020:00080000:1.0:1788581522.763597:0:17043:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff995e7b00ba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff995e50deae00 00010000:00010000:1.0:1788581522.763628:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a600/0x50f0cc74b7b314ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581522.763638:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a600/0x50f0cc74b7b314ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581522.763645:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a600/0x50f0cc74b7b314ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581522.763651:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581522.763656:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a600/0x50f0cc74b7b314ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581522.763662:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a600/0x50f0cc74b7b314ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581522.763677:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff995d42038000) 00010000:00010000:1.0:1788581522.763680:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581522.763685:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a600/0x50f0cc74b7b314ed lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581522.763692:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a600/0x50f0cc74b7b314ed lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17063 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0F:1788581522.764805:0:17103:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000001:00080000:3.0:1788581522.764898:0:19386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1788581522.764913:0:19386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000020:00080000:2.0:1788581522.765000:0:17103:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1788581523.011059:0:17823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788581523.011296:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581523.185938:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581523.185992:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581523.186014:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581523.186032:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581523.186051:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581523.186067:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581523.186082:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581523.186098:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581523.186117:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581523.186143:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170568704 00000100:00100000:2.0:1788581523.186152:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170568704 00000100:00100000:2.0:1788581523.186196:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 168 00000100:00100000:2.0:1788581523.186205:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:2395:x1875463170568704:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581523.186285:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:2395:x1875463170568704:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 81us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581523.186293:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 168 00000100:00100000:2.0:1788581523.186322:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170568832 00000100:00100000:2.0:1788581523.186325:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170568832 00000100:00100000:2.0:1788581523.186352:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170568960 00000100:00100000:2.0:1788581523.186355:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170568960 00000100:00100000:2.0:1788581523.186365:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170569344 00000100:00100000:2.0:1788581523.186367:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170569344 00000100:00100000:2.0:1788581523.186376:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170569472 00000100:00100000:2.0:1788581523.186378:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170569472 00000100:00100000:3.0:1788581523.186671:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:3.0:1788581523.186681:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+12:2395:x1875463170568832:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581523.186721:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+12:2395:x1875463170568832:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 43us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581523.186728:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:3.0:1788581523.186741:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:3.0:1788581523.186747:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+5:2395:x1875463170568960:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581523.186767:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e62527f4-3622-4ebf-800d-388b643273eb+5:2395:x1875463170568960:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 21us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581523.186774:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:3.0:1788581523.186796:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:3.0:1788581523.186802:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f276a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2396:x1875463170569344:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581523.186823:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f276a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2396:x1875463170569344:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 22us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581523.186829:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:3.0:1788581523.186866:0:19464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170569216 00000100:00100000:3.0:1788581523.186870:0:19464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170569216 00000100:00100000:3.0:1788581523.186896:0:19464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170569088 00000100:00100000:3.0:1788581523.186898:0:19464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170569088 00000100:00100000:3.0:1788581523.186912:0:19464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170569600 00000100:00100000:3.0:1788581523.186914:0:19464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170569600 00000100:00100000:3.0:1788581523.186923:0:19464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170569728 00000100:00100000:3.0:1788581523.186926:0:19464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170569728 00000100:00100000:3.0:1788581523.186937:0:19464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:3.0:1788581523.186943:0:19464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e62527f4-3622-4ebf-800d-388b643273eb+6:2395:x1875463170569216:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581523.186966:0:19464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e62527f4-3622-4ebf-800d-388b643273eb+6:2395:x1875463170569216:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581523.186986:0:19464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:3.0:1788581523.186997:0:19464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:3.0:1788581523.187003:0:19464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e62527f4-3622-4ebf-800d-388b643273eb+5:2392:x1875463170569088:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:3.0:1788581523.187018:0:19464:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b311a5 00000100:00080000:3.0:1788581523.187031:0:19464:0:(import.c:65:import_set_state_nolock()) ffff995e773f2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788581523.187080:0:19464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788581523.187199:0:19464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e62527f4-3622-4ebf-800d-388b643273eb+2:2392:x1875463170569088:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 196us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581523.187206:0:19464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:3.0:1788581523.187217:0:19464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:3.0:1788581523.187228:0:19464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f276300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2392:x1875463170569600:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:3.0:1788581523.187238:0:19464:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b311e4 00000100:00080000:3.0:1788581523.187243:0:19464:0:(import.c:65:import_set_state_nolock()) ffff995e43096800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788581523.187283:0:19464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788581523.187330:0:19464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f276300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+2:2392:x1875463170569600:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 102us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581523.187336:0:19464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:3.0:1788581523.187347:0:19464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:3.0:1788581523.187352:0:19464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2392:x1875463170569728:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:3.0:1788581523.187361:0:19464:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b311eb 00000100:00080000:3.0:1788581523.187367:0:19464:0:(import.c:65:import_set_state_nolock()) ffff995e773f9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788581523.187386:0:19464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788581523.187528:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:2.0:1788581523.187537:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2395:x1875463170569472:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581523.187563:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2395:x1875463170569472:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 29us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581523.187575:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00080000:2.0:1788581523.188150:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788581523.188155:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581523.188158:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788581523.188160:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788581523.188212:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581523.188217:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581523.188221:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581523.195959:0:19464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+2:2392:x1875463170569728:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 8595us (9829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581523.195985:0:19464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:3.0:1788581523.266127:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184265728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581523.266194:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581523.266282:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184265728 00000100:00100000:3.0:1788581523.266289:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184265728 00000100:00100000:3.0:1788581523.266334:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788581523.266344:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184265728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581523.266376:0:17068:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788581523.266421:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184265728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581523.266427:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788581523.266470:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184265728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581523.274607:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184265856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581523.274676:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581523.274752:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184265856 00000100:00100000:3.0:1788581523.274760:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184265856 00000100:00100000:3.0:1788581523.274798:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788581523.274808:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184265856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788581523.274840:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788581523.274886:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184265856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581523.274893:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788581523.274932:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184265856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581523.779436:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184265984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581523.779507:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581523.779722:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184265984 00000100:00100000:1.0:1788581523.779731:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184265984 00000100:00100000:1.0:1788581523.779787:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788581523.779795:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184265984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581523.779900:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788581523.779948:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184265984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581523.779955:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788581523.779991:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581523.780020:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1788581523.780025:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff995e7f657480, transno 8589934596 00000004:00080000:1.0:1788581523.780035:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1788581523.780059:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184265984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0F:1788581523.780407:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:611141c5-6f74-41ea-b38f-6fb1248f7899:3619:1875463184266112:0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.780452:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581523.780482:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184266624:0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.780508:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581523.780883:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184267136:0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.780912:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581523.780942:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788581523.780947:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184266496:0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.780979:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581523.780997:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184267008:0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.781015:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581523.781039:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184266240:0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.781060:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581523.781926:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184267136 00000100:00100000:3.0:1788581523.781935:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184267136 00000100:00100000:3.0:1788581523.781998:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184267008 00000100:00100000:3.0:1788581523.782001:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184267008 00000100:00100000:3.0:1788581523.782025:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788581523.782034:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184267136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.782633:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184266752:0@lo:400:kworker.0 00000100:00100000:3.0:1788581523.782917:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875463184267136:12345-0@lo:400:kworker.0 Request processed in 883us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581523.782926:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788581523.782947:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788581523.782954:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184267008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581523.782999:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184267008:12345-0@lo:400:kworker.0 Request processed in 46us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581523.783005:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788581523.783027:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581523.783031:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581523.783114:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581523.783142:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184267264:0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.783913:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581523.784392:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788581523.784403:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184266368:0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.784434:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581523.787368:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184266624 00000100:00100000:2.0:1788581523.787383:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184266624 00000100:00100000:2.0:1788581523.787446:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184266496 00000100:00100000:2.0:1788581523.787449:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184266496 00000100:00100000:2.0:1788581523.787466:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184266240 00000100:00100000:2.0:1788581523.787469:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184266240 00000100:00100000:2.0:1788581523.787494:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788581523.787503:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184266624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581523.787591:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184266624:12345-0@lo:400:kworker.0 Request processed in 89us (7081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581523.787599:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788581523.787617:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788581523.787623:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184266496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.788427:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184266880:0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.788466:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581523.788499:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184266752 00000100:00100000:1.0:1788581523.788506:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184266752 00000100:00100000:1.0:1788581523.788536:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184267264 00000100:00100000:1.0:1788581523.788540:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184267264 00000100:00100000:1.0:1788581523.788554:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184266368 00000100:00100000:1.0:1788581523.788557:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184266368 00000100:00100000:1.0:1788581523.788569:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788581523.788576:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184266752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581523.788617:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184266752:12345-0@lo:400:kworker.0 Request processed in 40us (5502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581523.788624:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788581523.788654:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788581523.788660:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184267264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581523.788689:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184267264:12345-0@lo:400:kworker.0 Request processed in 29us (4778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581523.788711:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788581523.788725:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788581523.788731:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184266368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581523.788761:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184266368:12345-0@lo:400:kworker.0 Request processed in 31us (4326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581523.788768:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788581523.790758:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581523.790768:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581523.790777:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581523.790908:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184266112 00000100:00100000:3.0:1788581523.790917:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184266112 00000100:00100000:3.0:1788581523.790977:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788581523.790987:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3619:x1875463184266112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581523.791060:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3619:x1875463184266112:12345-0@lo:400:kworker.0 Request processed in 74us (10606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581523.791067:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788581523.791103:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788581523.791112:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184266240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581523.791146:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184266240:12345-0@lo:400:kworker.0 Request processed in 36us (10085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581523.791163:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788581523.791756:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184266496:12345-0@lo:400:kworker.0 Request processed in 4131us (10774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581523.791766:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788581523.791884:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184267520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788581523.791930:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581523.792467:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184267392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581523.792498:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581523.792531:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184266240:0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.792555:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184266752:0@lo:400:kworker.0 00010000:00080000:0.0:1788581523.792568:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432c9c00 x1875463184267264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581523.792578:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184267264:0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.792605:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184266368:0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.792626:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184266880 00000100:00100000:0.0:1788581523.792632:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184266880 00000100:00100000:0.0:1788581523.792690:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788581523.792698:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184266880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.792742:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184266880:12345-0@lo:400:kworker.0 Request processed in 45us (4276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581523.792748:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1788581523.792784:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581523.792804:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184266496:0@lo:400:kworker.0 00010000:00080000:0.0:1788581523.792817:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d4339fb80 x1875463184267008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581523.792826:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184267008:0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.792836:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:611141c5-6f74-41ea-b38f-6fb1248f7899:3619:1875463184266112:0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.792845:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184266624:0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.792856:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875463184267136:0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.792887:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184266880:0@lo:400:kworker.0 00000100:00100000:0.0:1788581523.793430:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184267520 00000100:00100000:0.0:1788581523.793435:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184267520 00000100:00100000:0.0:1788581523.793456:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184267392 00000100:00100000:0.0:1788581523.793459:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184267392 00000100:00100000:0.0:1788581523.793472:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788581523.793479:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184267520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788581523.793494:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788581523.793538:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184267520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581523.793545:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788581523.793559:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581523.793564:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184267392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581523.793575:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788581523.793604:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184267392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581523.793610:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581523.793657:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184267392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581523.793875:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184267520:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788581524.047618:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581524.424238:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581524.424352:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170569856 00000100:00100000:3.0:1788581524.424372:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170569856 00000100:00100000:3.0:1788581524.424433:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 74 00000100:00100000:3.0:1788581524.424444:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+12:15551:x1875463170569856:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788581524.424545:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+12:15551:x1875463170569856:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 Request processed in 103us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581524.424552:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 74 00000100:00100000:2.0:1788581524.429836:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581524.429933:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170569984 00000100:00100000:0.0:1788581524.429943:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170569984 00000100:00100000:0.0:1788581524.430017:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 75 00000100:00100000:0.0:1788581524.430036:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+5:15551:x1875463170569984:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788581524.430140:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+5:15551:x1875463170569984:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 Request processed in 105us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581524.430148:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 75 00000100:00100000:2.0:1788581524.435644:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581524.435859:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170570240 00000100:00100000:0.0:1788581524.435881:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170570240 00000100:00100000:0.0:1788581524.435941:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:0.0:1788581524.435951:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e62527f4-3622-4ebf-800d-388b643273eb+12:15551:x1875463170570240:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788581524.436183:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e62527f4-3622-4ebf-800d-388b643273eb+13:15551:x1875463170570240:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 233us (549us total) trans 8589934636 rc 0/0 00000100:00100000:0.0:1788581524.436191:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00010000:00010000:2.0:1788581525.057968:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581526.082322:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581527.105427:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581527.873608:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581527.873634:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184267648:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581527.873709:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581527.873823:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184267648 00000100:00100000:3.0:1788581527.873831:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184267648 00000100:00100000:3.0:1788581527.873889:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788581527.873899:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184267648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788581527.873926:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788581527.873979:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184267648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581527.873999:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788581527.874039:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184267648:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788581527.874102:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788581528.130765:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581528.301713:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581528.301774:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581528.301805:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581528.301819:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581528.301834:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581528.301851:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581528.301915:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170570624 00000100:00100000:3.0:1788581528.301924:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170570368 00000100:00100000:0.0:1788581528.301926:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170570624 00000100:00100000:3.0:1788581528.301930:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170570368 00000100:00100000:3.0:1788581528.301987:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 170 00000100:00100000:3.0:1788581528.302003:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:2393:x1875463170570368:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581528.302039:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170570880 00000100:00100000:0.0:1788581528.302044:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170570880 00000100:00100000:0.0:1788581528.302059:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170570496 00000100:00100000:0.0:1788581528.302062:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170570496 00000100:00100000:3.0:1788581528.302068:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:2393:x1875463170570368:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 71us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581528.302076:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170571008 00000100:00100000:3.0:1788581528.302077:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 170 00000100:00100000:0.0:1788581528.302081:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170571008 00000100:00100000:0.0:1788581528.302101:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:0.0:1788581528.302110:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+5:2393:x1875463170570624:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581528.302113:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170570752 00000100:00100000:3.0:1788581528.302118:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170570752 00000100:00100000:3.0:1788581528.302145:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:3.0:1788581528.302157:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e62527f4-3622-4ebf-800d-388b643273eb+6:2393:x1875463170570752:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581528.302159:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+5:2393:x1875463170570624:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 46us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581528.302171:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:3.0:1788581528.302189:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e62527f4-3622-4ebf-800d-388b643273eb+6:2393:x1875463170570752:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 37us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581528.302195:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:3.0:1788581528.302202:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:0.0:1788581528.302208:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2393:x1875463170570880:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581528.302236:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2393:x1875463170570880:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 34us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581528.302242:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:0.0:1788581528.302469:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:0.0:1788581528.302479:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+13:2393:x1875463170570496:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581528.302523:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+13:2393:x1875463170570496:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 46us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581528.302648:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 82 00000100:00100000:3.0:1788581528.302658:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2393:x1875463170571008:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581528.302687:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2393:x1875463170571008:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 32us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581528.302693:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 82 00000100:00100000:0.0:1788581528.302747:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00080000:3.0:1788581528.302749:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581528.302756:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581528.302758:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788581528.390866:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184267776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788581528.390975:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581528.391228:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184267776 00000100:00100000:3.0:1788581528.391237:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184267776 00000100:00100000:3.0:1788581528.391308:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788581528.391318:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184267776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788581528.391349:0:17806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788581528.391407:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184267776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581528.391414:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788581528.391809:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184267776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788581528.392745:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581528.392759:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184267904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581528.392804:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581528.393093:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184267904 00000100:00100000:3.0:1788581528.393100:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184267904 00000100:00100000:3.0:1788581528.393143:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788581528.393152:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184267904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581528.393179:0:17068:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788581528.393227:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184267904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581528.393234:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788581528.393755:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184267904:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1788581528.903723:0:19386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22 00000020:00000080:2.0:1788581528.903733:0:19386:0:(genops.c:885:class_export_put()) final put ffff995e773f8000/55f5b9b8-e608-41f3-86b5-7c6aadc1cd22 00000020:00000080:0.0:1788581528.905138:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e773f8000/55f5b9b8-e608-41f3-86b5-7c6aadc1cd22 for lustre-OST0001 00000020:00000080:0.0:1788581528.905322:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e773f9000 for lustre-OST0001 00000100:00100000:3.0:1788581528.906616:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184268032:0@lo:400:kworker.0 00000100:00100000:3.0:1788581528.906691:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581528.906729:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184268544:0@lo:400:kworker.0 00000100:00100000:3.0:1788581528.906756:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581528.906776:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184269056:0@lo:400:kworker.0 00000100:00100000:3.0:1788581528.906797:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581528.906812:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184269568:0@lo:400:kworker.0 00000100:00100000:3.0:1788581528.906833:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581528.906858:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788581528.906864:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184268160:0@lo:400:kworker.0 00000100:00100000:3.0:1788581528.906904:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581528.906923:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184268672:0@lo:400:kworker.0 00000100:00100000:3.0:1788581528.906958:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581528.906975:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184269184:0@lo:400:kworker.0 00000100:00100000:3.0:1788581528.906996:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581528.907012:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184269696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581528.907036:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581528.907067:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184268544 00000100:00100000:3.0:1788581528.907074:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184268544 00000100:00100000:3.0:1788581528.907111:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184269056 00000100:00100000:3.0:1788581528.907114:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184269056 00000100:00100000:3.0:1788581528.907127:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184269568 00000100:00100000:3.0:1788581528.907129:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184269568 00000100:00100000:3.0:1788581528.907150:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184269184 00000100:00100000:3.0:1788581528.907154:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184269184 00000100:00100000:3.0:1788581528.907168:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788581528.907177:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184268544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581528.907229:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184268544:12345-0@lo:400:kworker.0 Request processed in 51us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581528.907236:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788581528.907274:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788581528.907282:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184269056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581528.907312:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184269056:12345-0@lo:400:kworker.0 Request processed in 31us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581528.907318:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788581528.907329:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788581528.907336:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184269568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581528.907613:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184269568:12345-0@lo:400:kworker.0 Request processed in 36us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581528.907621:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788581528.907636:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788581528.907643:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184269184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581528.907674:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184269184:12345-0@lo:400:kworker.0 Request processed in 32us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581528.907680:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788581528.907700:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184268160 00000100:00100000:3.0:1788581528.907704:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184268160 00000100:00100000:3.0:1788581528.907727:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184268672 00000100:00100000:3.0:1788581528.907729:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184268672 00000100:00100000:3.0:1788581528.907742:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788581528.907747:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184268160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581528.907777:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184268160:12345-0@lo:400:kworker.0 Request processed in 29us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581528.907783:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788581528.907794:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788581528.907800:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184268672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581528.907843:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184268672:12345-0@lo:400:kworker.0 Request processed in 43us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581528.907850:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1788581528.907866:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581528.907870:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581528.907887:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184269696 00000100:00100000:3.0:1788581528.907891:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184269696 00000100:00100000:3.0:1788581528.907919:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788581528.907943:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184269696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788581528.907965:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788581528.907997:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184269696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581528.908003:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788581528.908017:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581528.908052:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184268160:0@lo:400:kworker.0 00000100:00100000:3.0:1788581528.908063:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184268672:0@lo:400:kworker.0 00000100:00100000:3.0:1788581528.908072:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184269184:0@lo:400:kworker.0 00000100:00100000:3.0:1788581528.908087:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184269696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581528.908097:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184268544:0@lo:400:kworker.0 00000100:00100000:3.0:1788581528.908107:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184269056:0@lo:400:kworker.0 00010000:00080000:3.0:1788581528.908117:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d4339fb80 x1875463184269568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581528.908128:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184269568:0@lo:400:kworker.0 00000100:00100000:1.0:1788581528.908515:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184268416:0@lo:400:kworker.0 00000100:00100000:1.0:1788581528.908555:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581528.908578:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184268928:0@lo:400:kworker.0 00000100:00100000:1.0:1788581528.908601:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581528.908618:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4339ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875463184269440:0@lo:400:kworker.0 00000100:00100000:1.0:1788581528.908651:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581528.908677:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788581528.908683:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184268288:0@lo:400:kworker.0 00000100:00100000:1.0:1788581528.908704:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581528.908760:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4384d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184268800:0@lo:400:kworker.0 00000100:00100000:1.0:1788581528.908780:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581528.908795:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184269312:0@lo:400:kworker.0 00000100:00100000:1.0:1788581528.908814:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581528.908830:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184269824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581528.908847:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581528.908880:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184268416 00000100:00100000:1.0:1788581528.908885:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184268416 00000100:00100000:1.0:1788581528.908920:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184268928 00000100:00100000:1.0:1788581528.908924:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184268928 00000100:00100000:1.0:1788581528.908953:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184268288 00000100:00100000:1.0:1788581528.908956:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184268288 00000100:00100000:1.0:1788581528.908970:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184268800 00000100:00100000:1.0:1788581528.908973:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184268800 00000100:00100000:1.0:1788581528.908985:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788581528.908991:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184268416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581528.909026:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184268416:12345-0@lo:400:kworker.0 Request processed in 35us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581528.909032:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788581528.909047:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788581528.909053:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184268928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581528.909076:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184268928:12345-0@lo:400:kworker.0 Request processed in 24us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581528.909082:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788581528.909092:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788581528.909098:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184268288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581528.909121:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184268288:12345-0@lo:400:kworker.0 Request processed in 24us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581528.909126:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788581528.909137:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788581528.909142:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184268800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581528.909179:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184268800:12345-0@lo:400:kworker.0 Request processed in 37us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581528.909184:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788581528.909211:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581528.909213:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581528.909343:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184269440 00000100:00100000:1.0:1788581528.909348:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184269440 00000100:00100000:1.0:1788581528.909376:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184269312 00000100:00100000:1.0:1788581528.909379:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184269312 00000100:00100000:1.0:1788581528.909393:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788581528.909398:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875463184269440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581528.909431:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875463184269440:12345-0@lo:400:kworker.0 Request processed in 33us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581528.909452:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788581528.909492:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788581528.909500:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184269312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581528.909526:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184269312:12345-0@lo:400:kworker.0 Request processed in 28us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581528.909531:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1788581528.909547:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788581528.909567:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581528.909617:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184269824 00000100:00100000:1.0:1788581528.909621:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184269824 00000100:00100000:1.0:1788581528.909639:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788581528.909644:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184269824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581528.909659:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788581528.909691:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184269824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581528.909697:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788581528.909734:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184268288:0@lo:400:kworker.0 00000100:00100000:1.0:1788581528.909745:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184268800:0@lo:400:kworker.0 00010000:00080000:1.0:1788581528.909766:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43bb6300 x1875463184269312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581528.909776:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184269312:0@lo:400:kworker.0 00000100:00100000:1.0:1788581528.909790:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184269824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581528.909799:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184268416:0@lo:400:kworker.0 00000100:00100000:1.0:1788581528.909808:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4384dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184268928:0@lo:400:kworker.0 00000100:00100000:1.0:1788581528.909817:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4339ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875463184269440:0@lo:400:kworker.0 00000100:00100000:0.0:1788581528.910181:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184268032 00000100:00100000:0.0:1788581528.910187:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184268032 00000100:00100000:0.0:1788581528.910231:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788581528.910238:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3618:x1875463184268032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581528.910324:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3618:x1875463184268032:12345-0@lo:400:kworker.0 Request processed in 86us (3634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581528.910331:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788581528.910415:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184268032:0@lo:400:kworker.0 00000100:00100000:2.0:1788581528.915117:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581528.915147:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184269952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581528.915221:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581528.917358:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184269952 00000100:00100000:3.0:1788581528.917388:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184269952 00000100:00100000:3.0:1788581528.917450:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788581528.917461:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184269952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581528.917497:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788581528.917572:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184269952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (2350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581528.917580:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788581528.917868:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184269952:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788581528.918011:0:17043:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:1.0:1788581528.918021:0:17043:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:2.0:1788581528.918188:0:17103:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1788581528.918199:0:17103:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000001:00100000:2.0:1788581528.918860:0:18566:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22 00000020:00000080:2.0:1788581528.918874:0:18566:0:(genops.c:885:class_export_put()) final put ffff995d43a51000/55f5b9b8-e608-41f3-86b5-7c6aadc1cd22 00000001:00100000:2.0:1788581528.918895:0:18566:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e62527f4-3622-4ebf-800d-388b643273eb 00000020:00000080:2.0:1788581528.918898:0:18566:0:(genops.c:885:class_export_put()) final put ffff995e773f1000/e62527f4-3622-4ebf-800d-388b643273eb 00000020:00000080:0.0:1788581528.918961:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995d43a51000/55f5b9b8-e608-41f3-86b5-7c6aadc1cd22 for lustre-OST0000 00000020:00000080:0.0:1788581528.919014:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff995e773f1000/e62527f4-3622-4ebf-800d-388b643273eb for lustre-OST0000 00000020:00000080:0.0:1788581528.919026:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e43096800 for lustre-OST0000 00000020:00000080:0.0:1788581528.919031:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e773f2800 for lustre-OST0000 00010000:00010000:2.0:1788581529.153839:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581529.732447:0:17099:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788581529.732456:0:17099:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788581529.732490:0:17099:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788581529.732497:0:17099:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788581530.177672:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788581530.219611:0:20442:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 00:12:08 (1788581528) 00010000:00010000:3.0:1788581531.201727:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581532.225821:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581532.993621:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184270080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788581532.993695:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581532.993897:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184270080 00000100:00100000:1.0:1788581532.993913:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184270080 00000100:00100000:1.0:1788581532.993984:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788581532.993993:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184270080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788581532.994019:0:18574:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1788581532.994170:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581532.995783:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184270080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1785us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581532.995796:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788581532.995899:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184270080:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1788581533.251599:0:17823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788581533.255025:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581533.418132:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581533.418229:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581533.418280:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581533.418311:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581533.418329:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581533.418349:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581533.418381:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170571392 00000100:00100000:2.0:1788581533.418402:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170571392 00000100:00100000:2.0:1788581533.418456:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170571648 00000100:00100000:2.0:1788581533.418460:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170571648 00000100:00100000:2.0:1788581533.418473:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170571264 00000100:00100000:2.0:1788581533.418476:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170571264 00000100:00100000:2.0:1788581533.418487:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170571776 00000100:00100000:2.0:1788581533.418490:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170571776 00000100:00100000:2.0:1788581533.418505:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:2.0:1788581533.418514:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+5:2396:x1875463170571392:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581533.418590:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+5:2396:x1875463170571392:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 76us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581533.418597:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:2.0:1788581533.418614:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 90 00000100:00100000:2.0:1788581533.418621:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2396:x1875463170571648:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581533.418665:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2396:x1875463170571648:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 45us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581533.418672:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 90 00000100:00100000:2.0:1788581533.418685:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 91 00000100:00100000:2.0:1788581533.418691:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+12:2395:x1875463170571264:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581533.418714:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+12:2395:x1875463170571264:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 24us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581533.418720:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 91 00000100:00100000:2.0:1788581533.418731:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 92 00000100:00100000:2.0:1788581533.418738:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2395:x1875463170571776:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1788581533.418760:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2395:x1875463170571776:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581533.418766:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 92 00000100:00080000:2.0:1788581533.418783:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581533.418787:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788581533.422117:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170571520 00000100:00100000:1.0:1788581533.422134:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170571520 00000100:00100000:1.0:1788581533.422218:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:1.0:1788581533.422232:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f616d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e62527f4-3622-4ebf-800d-388b643273eb+6:2395:x1875463170571520:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581533.422351:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f616d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e62527f4-3622-4ebf-800d-388b643273eb+6:2395:x1875463170571520:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 123us (4019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581533.422371:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00080000:2.0:1788581533.422890:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581533.423832:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170571136 00000100:00100000:3.0:1788581533.423843:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170571136 00000100:00100000:3.0:1788581533.423910:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 172 00000100:00100000:3.0:1788581533.423921:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:2396:x1875463170571136:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581533.423988:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:2396:x1875463170571136:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 69us (5866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581533.423995:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 172 00000100:00100000:1.0:1788581533.505887:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184270208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581533.505969:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581533.506158:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184270208 00000100:00100000:2.0:1788581533.506166:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184270208 00000100:00100000:2.0:1788581533.506234:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788581533.506243:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184270208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788581533.506294:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788581533.506354:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184270208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581533.506361:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788581533.506744:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184270208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581533.507747:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581533.507764:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b64f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184270336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788581533.507820:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581533.507979:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184270336 00000100:00100000:1.0:1788581533.507986:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184270336 00000100:00100000:1.0:1788581533.508031:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788581533.508040:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4339fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184270336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788581533.508068:0:17806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788581533.508116:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4339fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184270336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581533.508122:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788581533.508700:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b64f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184270336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581533.729964:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581533.730020:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581533.730049:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581533.730123:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581533.730187:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170572032 00000100:00100000:3.0:1788581533.730196:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170572032 00000100:00100000:3.0:1788581533.730322:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170571904 00000100:00100000:3.0:1788581533.730326:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170571904 00000100:00100000:3.0:1788581533.730340:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170572160 00000100:00100000:3.0:1788581533.730343:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170572160 00000100:00100000:3.0:1788581533.730359:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:3.0:1788581533.730380:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcfe639d-128f-4392-a76c-783d2d1f3cef+15:2395:x1875463170572032:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581533.730403:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581533.730424:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b31189 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df223d7 expref: 15 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581533.730442:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581533.730489:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcfe639d-128f-4392-a76c-783d2d1f3cef+14:2395:x1875463170572032:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 111us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581533.730497:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:3.0:1788581533.730514:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:3.0:1788581533.730521:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f616a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcfe639d-128f-4392-a76c-783d2d1f3cef+13:2395:x1875463170571904:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581533.730528:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581533.730545:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0e600/0x50f0cc74b7b31182 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df223a6 expref: 13 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581533.730554:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581533.730574:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f616a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcfe639d-128f-4392-a76c-783d2d1f3cef+12:2395:x1875463170571904:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 53us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581533.730580:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:3.0:1788581533.730595:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:3.0:1788581533.730601:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f615c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcfe639d-128f-4392-a76c-783d2d1f3cef+11:2395:x1875463170572160:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581533.730608:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581533.730618:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f980e00/0x50f0cc74b7b3120e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2248d expref: 11 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581533.730626:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581533.730644:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f615c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcfe639d-128f-4392-a76c-783d2d1f3cef+10:2395:x1875463170572160:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 43us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581533.730650:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:1.0:1788581533.730946:0:19467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170572416 00000100:00100000:1.0:1788581533.730951:0:19467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170572416 00000100:00100000:1.0:1788581533.730994:0:19467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:1.0:1788581533.731002:0:19467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f615880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e62527f4-3622-4ebf-800d-388b643273eb+6:2392:x1875463170572416:12345-192.168.203.3@tcp:9:umount.0 00000020:00000080:1.0:1788581533.731033:0:19467:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b311ac 00000020:00010000:1.0:1788581533.731041:0:19467:0:(genops.c:1921:obd_stale_export_put()) Put export ffff995e4f10e800: total 0 00000100:00080000:1.0:1788581533.731045:0:19467:0:(import.c:65:import_set_state_nolock()) ffff995d43b10800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788581533.731095:0:19467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1788581533.731211:0:19467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f615880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e62527f4-3622-4ebf-800d-388b643273eb+4:2392:x1875463170572416:12345-192.168.203.3@tcp:9:umount.0 Request processed in 209us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581533.731218:0:19467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 32 00000020:00010000:0.0:1788581533.731696:0:17052:0:(genops.c:1907:obd_stale_export_get()) Get export ffff995e4f10e800: total 0 00010000:00010000:0.0:1788581533.731702:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581533.731737:0:17052:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff995e4f10e800, canceled 0 locks, left on hash table 1. 00002000:00010000:0.0:1788581533.731765:0:17052:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788581533.731768:0:17052:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788581516 -> 1788581517 00002000:00010000:0.0:1788581533.731771:0:17052:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788581516 -> 1788581517 00002000:00010000:0.0:1788581533.731773:0:17052:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788581533.731792:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006587fa02/0x50f0cc74b7b3151e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2256d expref: 3 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581533.731813:0:17052:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff995e4f10e800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788581533.731824:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581533.731826:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581533.731828:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581533.737688:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581533.738284:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170573312 00000100:00100000:0.0:1788581533.738294:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170573312 00000100:00100000:0.0:1788581533.738376:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:0.0:1788581533.738386:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+12:2392:x1875463170573312:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:0.0:1788581533.738428:0:17065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b31197 00000020:00010000:0.0:1788581533.738445:0:17065:0:(genops.c:1921:obd_stale_export_put()) Put export ffff995e773f2000: total 0 00000100:00080000:0.0:1788581533.738450:0:17065:0:(import.c:65:import_set_state_nolock()) ffff995e773f0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788581533.738481:0:17065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:0.0:1788581533.738650:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e62527f4-3622-4ebf-800d-388b643273eb+11:2392:x1875463170573312:12345-192.168.203.3@tcp:39:umount.0 Request processed in 264us (969us total) trans 8589934637 rc 0/0 00000100:00100000:0.0:1788581533.738658:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 76 00000020:00010000:2.0:1788581533.738898:0:18596:0:(genops.c:1907:obd_stale_export_get()) Get export ffff995e773f2000: total 0 00010000:00010000:2.0:1788581533.738957:0:18596:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff995e773f2000, canceled 0 locks, left on hash table 7. 00010000:00010000:2.0:1788581533.738991:0:18596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff995d42038000) 00010000:00010000:2.0:1788581533.738995:0:18596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788581533.739003:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0ee00/0x50f0cc74b7b314c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2254a expref: 10 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581533.739028:0:18596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995e6625e300) 00010000:00010000:2.0:1788581533.739031:0:18596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581533.739035:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b3127e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2249b expref: 9 pid: 20048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581533.739051:0:18596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6625ed00) 00010000:00010000:2.0:1788581533.739054:0:18596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788581533.739058:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b312bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224a9 expref: 8 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581533.739070:0:18596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581533.739073:0:18596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788581533.739077:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31468 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22535 expref: 7 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581533.739088:0:18596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff995d42038400) 00010000:00010000:2.0:1788581533.739090:0:18596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788581533.739103:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b800/0x50f0cc74b7b3152c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22574 expref: 6 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581533.739121:0:18596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff995e6f929b00) 00010000:00010000:2.0:1788581533.739123:0:18596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788581533.739127:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31262 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22494 expref: 5 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581533.739141:0:18596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff995d42038a00) 00010000:00010000:2.0:1788581533.739143:0:18596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788581533.739147:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995d43273600/0x50f0cc74b7b31342 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224d3 expref: 4 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581533.739159:0:18596:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff995e773f2000, canceled 7 locks, left on hash table 0. 00010000:00010000:2.0:1788581533.739172:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581533.739175:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581533.739177:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581533.756281:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581533.758392:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170573440 00000100:00100000:2.0:1788581533.758408:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170573440 00000100:00100000:2.0:1788581533.758531:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 77 00000100:00100000:2.0:1788581533.758542:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+5:2392:x1875463170573440:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:2.0:1788581533.758573:0:20048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b3119e 00000100:00080000:2.0:1788581533.758588:0:20048:0:(import.c:65:import_set_state_nolock()) ffff995e773f3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788581533.758618:0:20048:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788581533.758981:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e62527f4-3622-4ebf-800d-388b643273eb+3:2392:x1875463170573440:12345-192.168.203.3@tcp:39:umount.0 Request processed in 440us (2728us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788581533.758990:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 77 00010000:00010000:1.0:1788581533.760183:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581534.017485:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581534.017510:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184270464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581534.017585:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581534.017646:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184270464 00000100:00100000:1.0:1788581534.017653:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184270464 00000100:00100000:1.0:1788581534.017708:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788581534.017718:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184270464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581534.017820:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788581534.017941:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184270464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 223us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581534.017951:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788581534.017972:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184270464:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788581534.018088:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581534.018278:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581534.018292:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b64df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184270592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581534.018322:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581534.019699:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184270720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581534.019750:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581534.019794:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184270592 00000100:00100000:0.0:1788581534.019800:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184270592 00000100:00100000:0.0:1788581534.019839:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184270720 00000100:00100000:0.0:1788581534.019842:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184270720 00000100:00100000:0.0:1788581534.019859:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788581534.019866:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184270592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788581534.019891:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788581534.019942:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184270592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581534.019949:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788581534.019966:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788581534.019972:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184270720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788581534.019994:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788581534.020020:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184270720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581534.020025:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788581534.020074:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184270720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581534.020093:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b64df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184270592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581534.020297:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184270848:0@lo:400:kworker.0 00000100:00100000:3.0:1788581534.020343:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581534.020375:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184271360:0@lo:400:kworker.0 00000100:00100000:1.0:1788581534.020379:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184270848 00000100:00100000:1.0:1788581534.020383:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184270848 00000100:00100000:3.0:1788581534.020398:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581534.020412:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788581534.020414:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184271872:0@lo:400:kworker.0 00000100:00100000:1.0:1788581534.020418:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3620:x1875463184270848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581534.020435:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581534.020448:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3620:x1875463184270848:12345-0@lo:400:kworker.0 Request processed in 30us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581534.020455:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788581534.020458:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184270848:0@lo:400:kworker.0 00000100:00100000:3.0:1788581534.020487:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788581534.020494:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184270976:0@lo:400:kworker.0 00000100:00100000:1.0:1788581534.020499:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184271232:0@lo:400:kworker.0 00000100:00100000:1.0:1788581534.020518:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788581534.020531:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581534.020537:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184271744:0@lo:400:kworker.0 00000100:00100000:1.0:1788581534.020556:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581534.020558:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184271232 00000100:00100000:3.0:1788581534.020561:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184271232 00000100:00100000:1.0:1788581534.020571:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788581534.020576:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184271104:0@lo:400:kworker.0 00000100:00100000:3.0:1788581534.020584:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788581534.020590:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184271232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581534.020604:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581534.020619:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184271616:0@lo:400:kworker.0 00000100:00100000:3.0:1788581534.020620:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184271232:12345-0@lo:400:kworker.0 Request processed in 30us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581534.020626:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788581534.020636:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581534.020642:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581534.020656:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7fb36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184271488:0@lo:400:kworker.0 00000100:00100000:1.0:1788581534.020657:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184271232:0@lo:400:kworker.0 00000100:00100000:1.0:1788581534.020675:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184271872 00000100:00100000:3.0:1788581534.020676:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581534.020685:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184272000:0@lo:400:kworker.0 00000100:00100000:3.0:1788581534.020704:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581534.020722:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184270976 00000100:00100000:3.0:1788581534.020725:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184270976 00000100:00100000:3.0:1788581534.020746:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788581534.020752:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184270976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581534.020756:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184271872 00000100:00100000:3.0:1788581534.020785:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184270976:12345-0@lo:400:kworker.0 Request processed in 32us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581534.020785:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184271744 00000100:00100000:1.0:1788581534.020788:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184271744 00000100:00100000:3.0:1788581534.020791:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788581534.020800:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184271104 00000100:00100000:1.0:1788581534.020802:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184271104 00000100:00100000:1.0:1788581534.020812:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184271616 00000100:00100000:3.0:1788581534.020814:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184270976:0@lo:400:kworker.0 00000100:00100000:1.0:1788581534.020814:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184271616 00000100:00100000:1.0:1788581534.020824:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184271488 00000100:00100000:1.0:1788581534.020826:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184271488 00000100:00100000:1.0:1788581534.020836:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184272000 00000100:00100000:1.0:1788581534.020838:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184272000 00000100:00100000:3.0:1788581534.020840:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788581534.020846:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184271872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581534.020851:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788581534.020856:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184271744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581534.020892:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184271872:12345-0@lo:400:kworker.0 Request processed in 46us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581534.020892:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184271744:12345-0@lo:400:kworker.0 Request processed in 35us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581534.021226:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788581534.021380:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788581534.021385:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788581534.021394:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184271104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581534.021396:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788581534.021401:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184271616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581534.021427:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184271616:12345-0@lo:400:kworker.0 Request processed in 25us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581534.021427:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184271104:12345-0@lo:400:kworker.0 Request processed in 36us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581534.021433:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788581534.021436:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788581534.021444:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788581534.021447:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788581534.021449:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184271488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581534.021452:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184272000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581534.021474:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184271488:12345-0@lo:400:kworker.0 Request processed in 24us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581534.021480:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788581534.021480:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184272000:12345-0@lo:400:kworker.0 Request processed in 28us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581534.021485:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1788581534.021497:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788581534.021499:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581534.021507:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184271488:0@lo:400:kworker.0 00000100:00100000:1.0:1788581534.021517:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184271104:0@lo:400:kworker.0 00010000:00080000:3.0:1788581534.021519:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432ca680 x1875463184272000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581534.021525:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184271616:0@lo:400:kworker.0 00000100:00100000:3.0:1788581534.021528:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184272000:0@lo:400:kworker.0 00010000:00080000:1.0:1788581534.021535:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432ca300 x1875463184271744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581534.021537:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184271872:0@lo:400:kworker.0 00000100:00100000:1.0:1788581534.021543:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184271744:0@lo:400:kworker.0 00000100:00100000:3.0:1788581534.021566:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184271360 00000100:00100000:3.0:1788581534.021570:0:19099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184271360 00000100:00100000:3.0:1788581534.021602:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1788581534.021602:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581534.021609:0:19099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184271360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581534.021649:0:19099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184271360:12345-0@lo:400:kworker.0 Request processed in 41us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581534.021664:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788581534.021676:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7fb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184271360:0@lo:400:kworker.0 00010000:00010000:0.0:1788581534.273797:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581535.297561:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581536.017046:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581536.017094:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581536.017191:0:20093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170573568 00000100:00100000:0.0:1788581536.017200:0:20093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170573568 00000100:00100000:0.0:1788581536.017302:0:20093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170573696 00000100:00100000:0.0:1788581536.017305:0:20093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170573696 00000100:00100000:0.0:1788581536.017335:0:20093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:0.0:1788581536.017345:0:20093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f616300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcfe639d-128f-4392-a76c-783d2d1f3cef+11:2395:x1875463170573568:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581536.017360:0:20093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581536.017378:0:20093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f981600/0x50f0cc74b7b311c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22416 expref: 11 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581536.017396:0:20093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581536.017465:0:20093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f616300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcfe639d-128f-4392-a76c-783d2d1f3cef+10:2395:x1875463170573568:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 119us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581536.017472:0:20093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:2.0:1788581536.017865:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:2.0:1788581536.017875:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f614e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcfe639d-128f-4392-a76c-783d2d1f3cef+9:2396:x1875463170573696:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581536.017885:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581536.017913:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b311c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22447 expref: 9 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581536.017924:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581536.017947:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f614e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcfe639d-128f-4392-a76c-783d2d1f3cef+8:2396:x1875463170573696:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 74us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581536.017954:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:2.0:1788581536.024756:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581536.024853:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170573824 00000100:00100000:1.0:1788581536.024863:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170573824 00000100:00100000:1.0:1788581536.024942:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:1.0:1788581536.024953:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcfe639d-128f-4392-a76c-783d2d1f3cef+8:2393:x1875463170573824:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581536.024969:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581536.024989:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fb44400/0x50f0cc74b7b31207 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22486 expref: 8 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581536.025006:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581536.025058:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcfe639d-128f-4392-a76c-783d2d1f3cef+7:2393:x1875463170573824:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 107us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581536.025066:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:1.0:1788581536.029730:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581536.030231:0:20048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170574080 00000100:00100000:3.0:1788581536.030241:0:20048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170574080 00000100:00100000:3.0:1788581536.030351:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00100000:3.0:1788581536.030361:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+6:2392:x1875463170574080:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:3.0:1788581536.030400:0:20048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b311d6 00000020:00010000:3.0:1788581536.030408:0:20048:0:(genops.c:1921:obd_stale_export_put()) Put export ffff995e4f0df800: total 0 00000100:00080000:3.0:1788581536.030420:0:20048:0:(import.c:65:import_set_state_nolock()) ffff995e4f0d9000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788581536.030644:0:17051:0:(genops.c:1907:obd_stale_export_get()) Get export ffff995e4f0df800: total 0 00010000:00010000:2.0:1788581536.030694:0:17051:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff995e4f0df800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788581536.030728:0:17051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6625ed00) 00010000:00010000:2.0:1788581536.030732:0:17051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788581536.030740:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccac00/0x50f0cc74b7b312cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df224b0 expref: 5 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581536.030766:0:17051:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff995e4f0df800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788581536.030776:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581536.030778:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581536.030780:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788581536.030848:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:3.0:1788581536.031091:0:20048:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00100000:3.0:1788581536.031281:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+3:2392:x1875463170574080:12345-192.168.203.3@tcp:39:umount.0 Request processed in 920us (1558us total) trans 8589934638 rc 0/0 00000100:00100000:3.0:1788581536.031290:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00100000:0.0:1788581536.042703:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581536.042852:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170574208 00000100:00100000:1.0:1788581536.042862:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170574208 00000100:00100000:1.0:1788581536.042948:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:1.0:1788581536.042959:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+5:2392:x1875463170574208:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:1.0:1788581536.042998:0:17064:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b311dd 00000100:00080000:1.0:1788581536.043007:0:17064:0:(import.c:65:import_set_state_nolock()) ffff995e4f0da800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788581536.043036:0:17064:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788581536.043521:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55f5b9b8-e608-41f3-86b5-7c6aadc1cd22+3:2392:x1875463170574208:12345-192.168.203.3@tcp:39:umount.0 Request processed in 562us (825us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788581536.043531:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 79 00010000:00010000:2.0:1788581536.044019:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788581536.044115:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581536.098038:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581536.098135:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170574464 00000100:00100000:0.0:1788581536.098156:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170574464 00000100:00100000:0.0:1788581536.098214:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 174 00000100:00100000:0.0:1788581536.098224:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+7:2392:x1875463170574464:12345-192.168.203.3@tcp:251:umount.0 00000020:00000080:0.0:1788581536.098302:0:17057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b31174 00000020:00010000:0.0:1788581536.098310:0:17057:0:(genops.c:1921:obd_stale_export_put()) Put export ffff995e773f4000: total 0 00000100:00080000:0.0:1788581536.098324:0:17057:0:(import.c:65:import_set_state_nolock()) ffff995e773f3000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788581536.098389:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcfe639d-128f-4392-a76c-783d2d1f3cef+3:2392:x1875463170574464:12345-192.168.203.3@tcp:251:umount.0 Request processed in 166us (361us total) trans 0 rc 0/0 00000020:00010000:3.0:1788581536.098965:0:18596:0:(genops.c:1907:obd_stale_export_get()) Get export ffff995e773f4000: total 0 00010000:00010000:3.0:1788581536.098970:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581536.099019:0:18596:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff995e773f4000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788581536.099053:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f981400/0x50f0cc74b7b3117b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2239f expref: 3 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581536.099070:0:18596:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff995e773f4000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788581536.099081:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581536.099082:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581536.099084:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581536.099123:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 174 00000020:00000080:0.0:1788581536.099137:0:17057:0:(genops.c:885:class_export_put()) final put ffff995e773f4000/fcfe639d-128f-4392-a76c-783d2d1f3cef 00000020:00000080:2.0:1788581536.099698:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e773f4000/fcfe639d-128f-4392-a76c-783d2d1f3cef for MGS 00000020:00000080:2.0:1788581536.099741:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e773f3000 for MGS 00010000:00010000:2.0:1788581536.321810:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581537.346931:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581538.113604:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581538.113638:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184272128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788581538.113735:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581538.113818:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184272128 00000100:00100000:0.0:1788581538.113828:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184272128 00000100:00100000:0.0:1788581538.113908:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788581538.113919:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184272128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788581538.113958:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788581538.114012:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184272128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581538.114025:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788581538.114054:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581538.114096:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184272128:0@lo:13:osp-pre-0-1.0 00000020:01000004:2.0:1788581538.246819:0:20637:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788581538.263926:0:20637:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788581538.264016:0:20637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d3e expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581538.264037:0:20637:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30d3e expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581538.264047:0:20637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30d3e expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581538.264055:0:20637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30d3e expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581538.264086:0:20637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788581538.264093:0:20637:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788581538.264126:0:20637:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581538.264131:0:20637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788581538.264139:0:20637:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788581538.264173:0:20637:0:(import.c:65:import_set_state_nolock()) ffff995e4f27d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788581538.264389:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875463184272256:0@lo:39:umount.0 00000100:00100000:1.0:1788581538.264500:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581538.264923:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184272256 00000100:00100000:0.0:1788581538.264935:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184272256 00000100:00100000:0.0:1788581538.265004:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788581538.265016:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875463184272256:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788581538.265050:0:17063:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30d68 00000100:00080000:0.0:1788581538.265061:0:17063:0:(import.c:65:import_set_state_nolock()) ffff995e71e5c800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788581538.265082:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581538.265092:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30d3e expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.265121:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb44e00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581538.265126:0:18596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30d3e expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.265136:0:18596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b30d3e expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581538.265143:0:18596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b30d3e expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581538.265149:0:18596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788581538.265152:0:18596:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:0.0:1788581538.265155:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3617:x1875463184272256:12345-0@lo:39:umount.0 Request processed in 142us (655us total) trans 0 rc 0/0 10000000:01000000:3.0:1788581538.265156:0:18596:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1788581538.265163:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:0.0:1788581538.265179:0:17063:0:(genops.c:885:class_export_put()) final put ffff995e54d7d800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788581538.265194:0:18596:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30d3e expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.265201:0:18596:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:0.0:1788581538.265218:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e54d7d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:3.0:1788581538.265224:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30d3e expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.265231:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fb44e00/0x50f0cc74b7b30d37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30d3e expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.265244:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581538.265246:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581538.265247:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581538.265276:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:00000080:0.0:1788581538.265290:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e71e5c800 for lustre-MDT0000 00010000:00010000:2.0:1788581538.265359:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581538.265421:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184272384:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788581538.265446:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4f27d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788581538.265462:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581538.265465:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875463184272256:0@lo:39:umount.0 00000100:00100000:0.0:1788581538.265559:0:20093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184272384 00000100:00100000:0.0:1788581538.265565:0:20093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184272384 00000100:00100000:0.0:1788581538.265617:0:20093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788581538.265625:0:20093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f1f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3618:x1875463184272384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581538.265637:0:20093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581538.265655:0:20093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f981c00/0x50f0cc74b7b30d3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b30d37 expref: 24 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.265668:0:20093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581538.265704:0:20093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f1f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:611141c5-6f74-41ea-b38f-6fb1248f7899+23:3618:x1875463184272384:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581538.265711:0:20093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788581538.265724:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184272384:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788581538.265762:0:20637:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788581538.265766:0:20637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788581538.265771:0:20637:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788581538.266716:0:20637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c8f expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.266731:0:20637:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30c8f expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.266738:0:20637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30c8f expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.266745:0:20637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30c8f expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.266768:0:20637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581538.266786:0:20637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3116d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.266792:0:20637:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b3116d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.266798:0:20637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b3116d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.266804:0:20637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b3116d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.266822:0:20637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788581538.266828:0:20637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31246 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.266834:0:20637:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31246 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.266841:0:20637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b31246 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.266847:0:20637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b31246 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.266857:0:20637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788581538.266861:0:20637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30c81 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.266866:0:20637:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30c81 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.266888:0:20637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30c81 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.266895:0:20637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30c81 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.266903:0:20637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788581538.266906:0:20637:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1788581538.266910:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788581538.266917:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30c8f expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.266924:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb45600 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581538.266928:0:18596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30c8f expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.266936:0:18596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b30c8f expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788581538.266941:0:20637:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 10000000:00010000:3.0:1788581538.266943:0:18596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b30c8f expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1788581538.266945:0:20637:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 10000000:01000000:3.0:1788581538.266949:0:18596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00000080:0.0:1788581538.266949:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:01000000:3.0:1788581538.266952:0:18596:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788581538.266954:0:18596:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:00000080:0.0:1788581538.266955:0:20637:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1788581538.266962:0:20637:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff995e7fa4e800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788581538.266968:0:20637:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff995e7a4db800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788581538.266972:0:20637:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff995e4f10f000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788581538.266976:0:20637:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff995d41e58800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788581538.266983:0:20637:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff995e4f0df800 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22 192.168.203.3@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00010000:00010000:3.0:1788581538.266986:0:18596:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30c8f expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788581538.266988:0:20637:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff995e773f2000 e62527f4-3622-4ebf-800d-388b643273eb 192.168.203.3@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 00010000:00010000:3.0:1788581538.266993:0:18596:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1788581538.266993:0:20637:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff995e7fa00000) has exports, disconnecting them 00000020:00080000:0.0:1788581538.266998:0:20637:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff995e7fa4e800), last request at 1788581534 00000020:00000080:0.0:1788581538.267005:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30f9f 00010000:00010000:3.0:1788581538.267017:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30c8f expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.267024:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fb45600/0x50f0cc74b7b30c88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30c8f expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788581538.267024:0:20637:0:(import.c:65:import_set_state_nolock()) ffff995d43b12800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788581538.267040:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788581538.267043:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b3116d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.267058:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581538.267061:0:18596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b3116d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.267068:0:18596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b3116d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581538.267073:0:18596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b3116d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581538.267078:0:18596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000020:00080000:0.0:1788581538.267078:0:20637:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e7fa4e800): rc 0 10000000:01000000:3.0:1788581538.267081:0:18596:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000020:00000080:0.0:1788581538.267081:0:20637:0:(genops.c:885:class_export_put()) final put ffff995e7fa4e800/lustre-MDT0000-lwp-OST0001_UUID 10000000:01000000:3.0:1788581538.267083:0:18596:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:0.0:1788581538.267092:0:20637:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff995e7a4db800), last request at 1788581534 00010000:00010000:3.0:1788581538.267097:0:18596:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b3116d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788581538.267100:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30f05 00010000:00010000:3.0:1788581538.267103:0:18596:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1788581538.267106:0:20637:0:(import.c:65:import_set_state_nolock()) ffff995e7a4d8000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788581538.267109:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b3116d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.267115:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fa70400/0x50f0cc74b7b31166 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b3116d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788581538.267117:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa4e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:3.0:1788581538.267124:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581538.267127:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b31246 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.267133:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb45400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581538.267136:0:18596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b31246 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.267148:0:18596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b31246 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581538.267153:0:18596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b31246 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581538.267158:0:18596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000020:00000080:0.0:1788581538.267159:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d43b12800 for lustre-MDT0000 10000000:01000000:3.0:1788581538.267160:0:18596:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788581538.267162:0:18596:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:0.0:1788581538.267173:0:20637:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e7a4db800): rc 0 00010000:00010000:3.0:1788581538.267175:0:18596:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b31246 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788581538.267175:0:20637:0:(genops.c:885:class_export_put()) final put ffff995e7a4db800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1788581538.267181:0:18596:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1788581538.267182:0:20637:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff995e4f10f000), last request at 1788581461 00000020:00000080:0.0:1788581538.267185:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30e56 00000100:00080000:0.0:1788581538.267188:0:20637:0:(import.c:65:import_set_state_nolock()) ffff995e4f108800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788581538.267195:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b31246 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788581538.267195:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7a4db800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:3.0:1788581538.267202:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fb45400/0x50f0cc74b7b3123f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b31246 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.267210:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581538.267213:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30c81 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788581538.267218:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e7a4d8000 for lustre-MDT0000 00010000:00010000:3.0:1788581538.267219:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fb45a00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581538.267222:0:18596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30c81 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.267229:0:18596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b30c81 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788581538.267244:0:20637:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e4f10f000): rc 0 10000000:00010000:3.0:1788581538.267245:0:18596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b30c81 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788581538.267246:0:20637:0:(genops.c:885:class_export_put()) final put ffff995e4f10f000/lustre-MDT0000-lwp-MDT0001_UUID 10000000:01000000:3.0:1788581538.267250:0:18596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000020:00080000:0.0:1788581538.267273:0:20637:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff995d41e58800), last request at 1788581461 00000020:00000080:0.0:1788581538.267277:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30dfb 00000100:00080000:0.0:1788581538.267281:0:20637:0:(import.c:65:import_set_state_nolock()) ffff995d43a52800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788581538.267289:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4f10f000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788581538.267320:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e4f108800 for lustre-MDT0000 00000001:00000004:0.0:1788581538.267333:0:20637:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000020:00080000:0.0:1788581538.267419:0:20637:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995d41e58800): rc 0 00000004:00000080:0.0:1788581538.267428:0:20637:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffabf141607ae0 00000100:00080000:0.0:1788581538.267449:0:20637:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788581538.267452:0:20637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788581538.268247:0:20637:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788581538.268306:0:20637:0:(import.c:65:import_set_state_nolock()) ffff995d43bf2800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788581538.268383:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184272768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581538.268471:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581538.268564:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184272640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581538.268592:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581538.268613:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581538.268619:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d439d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184272512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581538.268637:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581538.268667:0:20093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184272768 00000100:00100000:0.0:1788581538.268675:0:20093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184272768 00000100:00100000:0.0:1788581538.268722:0:20093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184272640 00000100:00100000:0.0:1788581538.268725:0:20093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184272640 00000100:00100000:0.0:1788581538.268738:0:20093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184272512 00000100:00100000:0.0:1788581538.268740:0:20093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184272512 00000100:00100000:0.0:1788581538.268756:0:20093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788581538.268766:0:20093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:611141c5-6f74-41ea-b38f-6fb1248f7899+25:3618:x1875463184272768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581538.268783:0:20093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581538.268807:0:20093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f980400/0x50f0cc74b7b31246 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b3123f expref: 25 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581538.268826:0:20093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581538.268864:0:20093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3618:x1875463184272768:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (393us total) trans 0 rc 0/0 10000000:01000000:3.0:1788581538.268885:0:18596:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788581538.268890:0:18596:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788581538.268922:0:18596:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30c81 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.268929:0:18596:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581538.268938:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30c81 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.268944:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fb45a00/0x50f0cc74b7b30c7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30c81 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581538.268958:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581538.268960:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581538.268962:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581538.268973:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:611141c5-6f74-41ea-b38f-6fb1248f7899:3619:1875463184273024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581538.269008:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581538.269442:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184272768:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581538.269627:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581538.269657:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184273024 00000100:00100000:1.0:1788581538.269667:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184273024 00010000:00010000:3.0:1788581538.270591:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581538.271884:0:20093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581538.272324:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581538.272349:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+24:3621:x1875463184272640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581538.272368:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581538.272389:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b3116d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b31166 expref: 24 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581538.272405:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581538.272483:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+23:3621:x1875463184272640:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (3889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581538.272508:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581538.272532:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581538.272539:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f616a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+22:3621:x1875463184272512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581538.272547:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581538.272557:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fb44c00/0x50f0cc74b7b30c8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b30c88 expref: 22 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581538.272566:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581538.272589:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f616a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+21:3621:x1875463184272512:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (3951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581538.272595:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581538.272607:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788581538.272613:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+20:3619:x1875463184273024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581538.272619:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581538.272627:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d4600/0x50f0cc74b7b30c81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b30c7a expref: 20 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581538.272635:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581538.273532:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:611141c5-6f74-41ea-b38f-6fb1248f7899+19:3619:x1875463184273024:12345-0@lo:103:ldlm_bl.0 Request processed in 914us (4518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581538.273542:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788581538.273596:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:611141c5-6f74-41ea-b38f-6fb1248f7899:3619:1875463184273024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581538.273631:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d439d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184272512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581538.273640:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184272640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581538.273789:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184272896:0@lo:39:umount.0 00000100:00100000:1.0:1788581538.273836:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581538.273886:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184272896 00000100:00100000:1.0:1788581538.273893:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184272896 00000100:00100000:1.0:1788581538.273927:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788581538.273934:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875463184272896:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788581538.273959:0:17069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30e80 00000100:00080000:1.0:1788581538.273967:0:17069:0:(import.c:65:import_set_state_nolock()) ffff995e7fa35000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788581538.273988:0:17069:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788581538.274097:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3617:x1875463184272896:12345-0@lo:39:umount.0 Request processed in 163us (261us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788581538.274105:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1788581538.274140:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d43bf2800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788581538.274148:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184272896:0@lo:39:umount.0 00010000:00010000:1.0:1788581538.274160:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788581538.274230:0:20637:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788581538.274234:0:20637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1788581538.274245:0:20637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788581538.274435:0:20637:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788581538.274453:0:20637:0:(import.c:65:import_set_state_nolock()) ffff995e72849000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788581538.274466:0:20637:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788581538.274468:0:20637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1788581538.274476:0:20637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788581538.274550:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184273152:0@lo:9:umount.0 00000100:00100000:1.0:1788581538.274579:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581538.274613:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184273152 00000100:00100000:1.0:1788581538.274618:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184273152 00000100:00100000:1.0:1788581538.274796:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788581538.274806:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875463184273152:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788581538.274830:0:18572:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30fc2 00000100:00080000:1.0:1788581538.274835:0:18572:0:(import.c:65:import_set_state_nolock()) ffff995d42ce1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788581538.274891:0:18572:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788581538.274986:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3617:x1875463184273152:12345-0@lo:9:umount.0 Request processed in 182us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581538.274993:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1788581538.275013:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788581538.275030:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e72849000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788581538.275037:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788581538.275039:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788581538.275042:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184273152:0@lo:9:umount.0 00000100:00080000:1.0:1788581538.275063:0:20637:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788581538.275073:0:20637:0:(import.c:65:import_set_state_nolock()) ffff995e4f27e000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788581538.275088:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184273280:0@lo:9:umount.0 00000100:00100000:1.0:1788581538.275115:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581538.275159:0:19467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184273280 00000100:00100000:1.0:1788581538.275163:0:19467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184273280 00000100:00100000:1.0:1788581538.275201:0:19467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788581538.275208:0:19467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d439d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3617:x1875463184273280:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788581538.275221:0:19467:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30fc9 00000100:00080000:1.0:1788581538.275228:0:19467:0:(import.c:65:import_set_state_nolock()) ffff995d42ce6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788581538.275308:0:19467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00010000:00010000:2.0:1788581538.275321:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581538.275392:0:19467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d439d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3617:x1875463184273280:12345-0@lo:9:umount.0 Request processed in 183us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581538.275400:0:19467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788581538.275460:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4f27e000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000020:00080000:1.0:1788581538.275475:0:20637:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff995e7fa00000) has no exports 00000004:00080000:2.0:1788581538.275485:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788581538.275489:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788581538.275495:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184273280:0@lo:9:umount.0 00000100:00080000:0.0:1788581538.275717:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581538.275723:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1788581538.284687:0:20637:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff995e7fa00000) has no exports 00000020:00000080:0.0:1788581538.343376:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30cd5 00000020:00000080:0.0:1788581538.343388:0:20637:0:(genops.c:885:class_export_put()) final put ffff995e7fa4b000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788581538.343410:0:20637:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788581538.343457:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa4b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788581538.343641:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581538.343663:0:20637:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788581538.343668:0:20637:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff995d42c03370) has no exports 00000020:00000080:1.0:1788581538.344132:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30cce 00000020:00000080:1.0:1788581538.344140:0:20637:0:(genops.c:885:class_export_put()) final put ffff995e4864a800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788581538.344189:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4864a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788581538.344215:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581538.344221:0:20637:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788581538.344223:0:20637:0:(genops.c:885:class_export_put()) final put ffff995e4864b800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788581538.344225:0:20637:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4864b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788581538.344234:0:20637:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1788581538.370378:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581538.625890:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184273408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581538.625955:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581538.626048:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184273408 00000100:00100000:3.0:1788581538.626056:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184273408 00000100:00100000:3.0:1788581538.626103:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788581538.626114:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3620:x1875463184273408:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788581538.626122:0:17806:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788581538.626171:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3620:x1875463184273408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (213us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788581538.626177:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:02020000:0.0:1788581538.626270:0:3620:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1788581538.633867:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788581538.633888:0:3620:0:(import.c:65:import_set_state_nolock()) ffff995e7fa8e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788581538.633893:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788581538.664188:0:3620:0:(import.c:65:import_set_state_nolock()) ffff995e7fa8e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788581538.664202:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 447 00000100:00080000:0.0:1788581538.664211:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff995e7fa8e800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581538.667710:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e7f616300 x1875463184273536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581538.667771:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184273536:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788581538.667853:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581538.667934:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184273536 00000100:00100000:1.0:1788581538.667943:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184273536 00000100:00100000:1.0:1788581538.667988:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788581538.667995:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875463184273536:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788581538.668010:0:17068:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788581538.688936:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875463184273536:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 20934us (21077us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788581538.688951:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1788581538.696011:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7fa8e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581538.696024:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788581538.696029:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184273536:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1788581539.138143:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788581539.138149:0:15242:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788581539.138152:0:15242:0:(import.c:65:import_set_state_nolock()) ffff995e7fa8e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788581539.138161:0:15242:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 524 00000100:00080000:0.0:1788581539.138177:0:15242:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788581539.138184:0:15242:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff995e7fa8e800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581539.138207:0:15242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43814700 x1875463184273920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581539.138694:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184274048:0@lo:400:kworker.0 00000100:00100000:1.0:1788581539.138763:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581539.138798:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184274560:0@lo:400:kworker.0 00000100:00100000:1.0:1788581539.138824:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581539.138849:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788581539.138855:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:611141c5-6f74-41ea-b38f-6fb1248f7899:3619:1875463184273792:0@lo:400:kworker.0 00000100:00100000:1.0:1788581539.138899:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581539.138924:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45150700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184274432:0@lo:400:kworker.0 00000100:00100000:1.0:1788581539.138946:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581539.138976:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184274048 00000100:00100000:1.0:1788581539.138991:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184274048 00000100:00100000:1.0:1788581539.139036:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788581539.139045:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184274048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581539.139091:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184274048:12345-0@lo:400:kworker.0 Request processed in 46us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581539.139100:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788581539.139126:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184274560 00000100:00100000:1.0:1788581539.139130:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184274560 00000100:00100000:1.0:1788581539.139160:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184274432 00000100:00100000:1.0:1788581539.139163:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184274432 00000100:00100000:3.0:1788581539.139290:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184273920:0@lo:38:kworker.0 00000100:00100000:3.0:1788581539.139331:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581539.139375:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184273920 00000100:00100000:3.0:1788581539.139380:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184273920 00000100:00100000:2.0:1788581539.139404:0:20048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788581539.139408:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788581539.139416:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875463184273920:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788581539.139420:0:20048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184274560:12345-0@lo:400:kworker.0 00010000:02000000:3.0:1788581539.139433:0:17069:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788581539.139480:0:20048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184274560:12345-0@lo:400:kworker.0 Request processed in 65us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581539.139486:0:20048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788581539.139512:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184274176:0@lo:400:kworker.0 00000100:00100000:2.0:1788581539.139552:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581539.139573:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184274688:0@lo:400:kworker.0 00000100:00100000:2.0:1788581539.139594:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581539.139615:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184274688 00000100:00100000:2.0:1788581539.139619:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184274688 00000100:00100000:2.0:1788581539.139640:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788581539.139644:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875463184274688:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788581539.139649:0:17063:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788581539.139674:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875463184274688:12345-0@lo:400:kworker.0 Request processed in 28us (79us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788581539.139680:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788581539.139712:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788581539.139716:0:3620:0:(import.c:65:import_set_state_nolock()) ffff995e71e5e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788581539.139720:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788581539.139724:0:3620:0:(import.c:65:import_set_state_nolock()) ffff995e71e5e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581539.139728:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 477 00000100:00080000:2.0:1788581539.139733:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff995e71e5e000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581539.139756:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e550ad500 x1875463184274944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788581539.139757:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875463184273920:12345-0@lo:38:kworker.0 Request processed in 337us (422us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788581539.139767:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788581539.139786:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184274688:0@lo:400:kworker.0 00000100:00100000:3.0:1788581539.139797:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184274944:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788581539.139806:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788581539.139817:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184273664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581539.139827:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581539.139851:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788581539.139858:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7fa8e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581539.139864:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788581539.139881:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184273920:0@lo:38:kworker.0 00000100:00100000:2.0:1788581539.139886:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184274304:0@lo:400:kworker.0 00000100:00100000:3.0:1788581539.139905:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184274944 00000100:00100000:3.0:1788581539.139910:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184274944 00000100:00100000:2.0:1788581539.139914:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581539.140022:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184273664 00000100:00100000:0.0:1788581539.140026:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184273664 00000100:00100000:0.0:1788581539.140055:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788581539.140063:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184273664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788581539.140084:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788581539.140118:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184273664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581539.140125:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788581539.140189:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184274176 00000100:00100000:0.0:1788581539.140194:0:19099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184274176 00000100:00100000:0.0:1788581539.140215:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788581539.140222:0:19099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184274176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581539.140280:0:19099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184274176:12345-0@lo:400:kworker.0 Request processed in 30us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581539.140288:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788581539.146739:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184274304 00000100:00100000:3.0:1788581539.146756:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184274304 00000100:00100000:3.0:1788581539.146795:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788581539.146804:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875463184274944:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788581539.146838:0:17063:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788581539.146942:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875463184274944:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 138us (7114us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788581539.146951:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788581539.146966:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788581539.146971:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875463184274432:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788581539.146978:0:17063:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788581539.147002:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875463184274432:12345-0@lo:400:kworker.0 Request processed in 30us (8055us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788581539.147008:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788581539.147026:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788581539.147030:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875463184274304:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788581539.147035:0:17063:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788581539.147057:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875463184274304:12345-0@lo:400:kworker.0 Request processed in 26us (7145us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788581539.147063:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788581539.147110:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e71e5e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581539.147115:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788581539.147119:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184274944:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1788581539.147484:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788581539.147489:0:3620:0:(import.c:65:import_set_state_nolock()) ffff995e44e1c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788581539.147493:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788581539.147498:0:3620:0:(import.c:65:import_set_state_nolock()) ffff995e44e1c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581539.147503:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 447 00000100:00080000:3.0:1788581539.147509:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff995e44e1c000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581539.147546:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d432c8000 x1875463184275072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788581539.147577:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184274304:0@lo:400:kworker.0 00000100:00100000:3.0:1788581539.147590:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875463184275072:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788581539.147627:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581539.147656:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184275072 00000100:00100000:3.0:1788581539.147660:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184275072 00000100:00100000:3.0:1788581539.147676:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788581539.147681:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875463184275072:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788581539.147690:0:17063:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788581539.147717:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875463184275072:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 35us (89us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788581539.147724:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788581539.147745:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e44e1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581539.147748:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788581539.147751:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875463184275072:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788581539.147768:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184274816:0@lo:400:kworker.0 00000100:00100000:3.0:1788581539.147789:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581539.147805:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184274816 00000100:00100000:3.0:1788581539.147809:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184274816 00000100:00100000:3.0:1788581539.147835:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788581539.147841:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184274816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581539.147887:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875463184274816:12345-0@lo:400:kworker.0 Request processed in 46us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581539.147893:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:3.0:1788581539.147926:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e45151500 x1875463184274816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581539.147937:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875463184274816:0@lo:400:kworker.0 00000100:00100000:3.0:1788581539.147949:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184274176:0@lo:400:kworker.0 00000100:00100000:3.0:1788581539.147974:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184273664:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788581539.148014:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581539.148019:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581539.148041:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788581539.148045:0:3619:0:(import.c:65:import_set_state_nolock()) ffff995e7a4d9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788581539.148049:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788581539.148052:0:3619:0:(import.c:65:import_set_state_nolock()) ffff995e7a4d9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581539.148056:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 462 00000100:00080000:3.0:1788581539.148061:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff995e7a4d9800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581539.148075:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e7f614e00 x1875463184275200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788581539.148090:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45150700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184274432:0@lo:400:kworker.0 00000100:00100000:3.0:1788581539.148104:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184274048:0@lo:400:kworker.0 00010000:00080000:3.0:1788581539.148115:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e45153800 x1875463184274560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581539.148123:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184274560:0@lo:400:kworker.0 00000100:00100000:3.0:1788581539.148144:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875463184275200:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788581539.148601:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581539.148643:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184275200 00000100:00100000:3.0:1788581539.148648:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184275200 00000100:00100000:3.0:1788581539.148666:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788581539.148672:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875463184275200:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1788581539.148685:0:17063:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788581539.148720:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875463184275200:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 47us (553us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788581539.148727:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788581539.148750:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7a4d9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581539.148754:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788581539.148758:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875463184275200:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788581539.148792:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184273792 00000100:00100000:3.0:1788581539.148795:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184273792 00000100:00100000:3.0:1788581539.148821:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788581539.148828:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7c354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+19:3619:x1875463184273792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581539.148878:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7c354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:611141c5-6f74-41ea-b38f-6fb1248f7899+19:3619:x1875463184273792:12345-0@lo:400:kworker.0 Request processed in 39us (9966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581539.148884:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788581539.148924:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:611141c5-6f74-41ea-b38f-6fb1248f7899:3619:1875463184273792:0@lo:400:kworker.0 00010000:00010000:1.0:1788581539.395368:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788581539.656338:0:17796:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788581539.656352:0:17796:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1788581539.656357:0:17796:0:(genops.c:885:class_export_put()) final put ffff995e43207000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788581539.656377:0:17796:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22 00000001:00080000:0.0:1788581539.656383:0:17796:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1788581539.656385:0:17796:0:(genops.c:885:class_export_put()) final put ffff995e4f0de800/55f5b9b8-e608-41f3-86b5-7c6aadc1cd22 00000001:00100000:0.0:1788581539.656390:0:17796:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e62527f4-3622-4ebf-800d-388b643273eb 00000001:00080000:0.0:1788581539.656394:0:17796:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1788581539.656396:0:17796:0:(genops.c:885:class_export_put()) final put ffff995e773f7800/e62527f4-3622-4ebf-800d-388b643273eb 00000020:00000080:3.0:1788581539.656407:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e43207000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788581539.656470:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4f0de800/55f5b9b8-e608-41f3-86b5-7c6aadc1cd22 for lustre-MDT0001 00000020:00000080:3.0:1788581539.656495:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e773f7800/e62527f4-3622-4ebf-800d-388b643273eb for lustre-MDT0001 00000020:00000080:3.0:1788581539.656517:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e7fa35000 for lustre-MDT0001 00000020:00000080:3.0:1788581539.656522:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e4f0da800 for lustre-MDT0001 00000020:00000080:3.0:1788581539.656526:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e773f3800 for lustre-MDT0001 00000001:00100000:1.0:1788581539.656846:0:17043:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788581539.656850:0:17043:0:(genops.c:885:class_export_put()) final put ffff995d41e58800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788581539.656926:0:17043:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 55f5b9b8-e608-41f3-86b5-7c6aadc1cd22 00000001:00080000:1.0:1788581539.656933:0:17043:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:1.0:1788581539.656936:0:17043:0:(genops.c:885:class_export_put()) final put ffff995e4f0df800/55f5b9b8-e608-41f3-86b5-7c6aadc1cd22 00000020:00000080:3.0:1788581539.658745:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995d41e58800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788581539.658815:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d43a52800 for lustre-MDT0000 00000001:00100000:2.0:1788581539.661437:0:19386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788581539.661445:0:19386:0:(genops.c:885:class_export_put()) final put ffff995d42ce5800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788581539.661482:0:19386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e62527f4-3622-4ebf-800d-388b643273eb 00000020:00000080:2.0:1788581539.661485:0:19386:0:(genops.c:885:class_export_put()) final put ffff995e4f10e800/e62527f4-3622-4ebf-800d-388b643273eb 00000020:00000080:0.0:1788581539.661510:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995d42ce5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788581539.661552:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4f10e800/e62527f4-3622-4ebf-800d-388b643273eb for lustre-OST0001 00000020:00000080:0.0:1788581539.661569:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d42ce6000 for lustre-OST0001 00000020:00000080:0.0:1788581539.661573:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d43b10800 for lustre-OST0001 00000001:00100000:1.0:1788581539.664562:0:17043:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e62527f4-3622-4ebf-800d-388b643273eb 00000001:00080000:1.0:1788581539.664574:0:17043:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:1.0:1788581539.664580:0:17043:0:(genops.c:885:class_export_put()) final put ffff995e773f2000/e62527f4-3622-4ebf-800d-388b643273eb 00000020:00000080:3.0:1788581539.666837:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4f0df800/55f5b9b8-e608-41f3-86b5-7c6aadc1cd22 for lustre-MDT0000 00000020:00000080:3.0:1788581539.666921:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e773f2000/e62527f4-3622-4ebf-800d-388b643273eb for lustre-MDT0000 00000020:00000080:3.0:1788581539.666946:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e4f0d9000 for lustre-MDT0000 00000020:00000080:3.0:1788581539.666951:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e773f0800 for lustre-MDT0000 00000020:01000000:1.0:1788581540.354159:0:20637:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995d4385dcc0 - data ffff995e6b5c16c0/ffff995e7561d800 00000020:01000000:1.0:1788581540.354358:0:20637:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995e5317c4e0 - data ffff995e6b6c1438/ffff995e47fae000 00000001:00000004:1.0:1788581540.363616:0:20637:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:1.0:1788581540.397587:0:20637:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788581540.397598:0:20637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788581540.397613:0:20637:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff995d44071f80 x1875463184272896/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788581548 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581540.397639:0:20637:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788581540.400055:0:20637:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788581540.400073:0:20637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1788581540.400093:0:20637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788581540.400095:0:20637:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788581540.402869:0:17087:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788581540.402876:0:17087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788581540.402891:0:17087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788581540.409746:0:20637:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788581540.409754:0:20637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1788581540.409770:0:20637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788581540.409773:0:20637:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788581540.410142:0:17089:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788581540.410147:0:17089:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:3.0:1788581540.415488:0:17089:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788581540.417084:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30c9d 00000020:00000080:1.0:1788581540.417095:0:20637:0:(genops.c:885:class_export_put()) final put ffff995d43bf2000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788581540.418854:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30cb2 00000020:00000080:1.0:1788581540.418874:0:20637:0:(genops.c:885:class_export_put()) final put ffff995e7284b800/lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788581540.420329:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788581540.422662:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995d43bf2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788581540.423117:0:20637:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788581540.423127:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581540.423136:0:20637:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788581540.423141:0:20637:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff995e7fa04d28) has no exports 00000020:00000080:2.0:1788581540.423533:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7284b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1788581540.423609:0:20637:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788581540.423619:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30d14 00000020:00000080:1.0:1788581540.423627:0:20637:0:(genops.c:885:class_export_put()) final put ffff995e6fadc800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788581540.423642:0:20637:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788581540.423646:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581540.423651:0:20637:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788581540.423654:0:20637:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff995e81dcb370) has no exports 00000020:00000080:1.0:1788581540.423661:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30d0d 00000020:00000080:1.0:1788581540.423665:0:20637:0:(genops.c:885:class_export_put()) final put ffff995e4f278000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788581540.423937:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6fadc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788581540.423944:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4f278000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788581540.424104:0:20637:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788581540.424108:0:20637:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788581540.424112:0:20637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1788581540.424119:0:20637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788581540.424121:0:20637:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788581540.424191:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581540.424199:0:20637:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788581540.424204:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30cff 00000020:00000080:1.0:1788581540.424209:0:20637:0:(genops.c:885:class_export_put()) final put ffff995e4f27d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788581540.424403:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e4f27e000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788581540.424410:0:15242:0:(genops.c:885:class_export_put()) final put ffff995e4f27b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788581540.424413:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4f27b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788581540.424421:0:15242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788581540.434728:0:20637:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788581540.434742:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581540.434753:0:20637:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788581540.434758:0:20637:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff995e7a738000) has no exports 00000020:00000080:1.0:1788581540.434768:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30cf8 00000020:00000080:1.0:1788581540.434775:0:20637:0:(genops.c:885:class_export_put()) final put ffff995d41e5a000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788581540.438871:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4f27d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788581540.440482:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995d41e5a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788581540.445933:0:20637:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788581540.445942:0:20637:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788581540.445946:0:20637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1788581540.445955:0:20637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788581540.445957:0:20637:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788581540.446061:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581540.446073:0:20637:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788581540.446089:0:20637:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788581540.446097:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30cea 00000020:00000080:1.0:1788581540.446106:0:20637:0:(genops.c:885:class_export_put()) final put ffff995d41e5e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788581540.447245:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e72849000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788581540.447682:0:15242:0:(genops.c:885:class_export_put()) final put ffff995d41e5a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788581540.447689:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995d41e5a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788581540.447697:0:15242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788581540.450677:0:20637:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788581540.450929:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581540.450940:0:20637:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788581540.450947:0:20637:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff995e7a73cd28) has no exports 00000020:00000080:1.0:1788581540.450955:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30ce3 00000020:00000080:1.0:1788581540.450964:0:20637:0:(genops.c:885:class_export_put()) final put ffff995d43bf7800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788581540.456831:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995d41e5e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788581540.460885:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995d43bf7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788581540.460916:0:20637:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788581540.460920:0:20637:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788581540.460924:0:20637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788581540.460930:0:20637:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788581540.461086:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788581540.461096:0:20637:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788581540.461123:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788581540.461127:0:20637:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788581540.461131:0:20637:0:(genops.c:885:class_export_put()) final put ffff995d43bf7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788581540.461134:0:20637:0:(genops.c:844:class_export_destroy()) destroying export ffff995d43bf7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788581540.461139:0:20637:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788581540.461237:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30cb9 00000020:00000080:3.0:1788581540.461244:0:20637:0:(genops.c:885:class_export_put()) final put ffff995e7284b000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788581540.461312:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d43bf2800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788581540.461320:0:15242:0:(genops.c:885:class_export_put()) final put ffff995e7fa4f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788581540.461323:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa4f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788581540.461333:0:15242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788581540.464539:0:20637:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788581540.464556:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788581540.464566:0:20637:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788581540.464583:0:20637:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff995e7fa019b8) has no exports 00000020:00000080:3.0:1788581540.464616:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788581540.464623:0:20637:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788581540.464631:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30cc0 00000020:00000080:3.0:1788581540.464639:0:20637:0:(genops.c:885:class_export_put()) final put ffff995e7284a000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788581540.464650:0:20637:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e4eb3d800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788581540.464653:0:20637:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e4eb3d800 3 00000020:01000004:3.0:1788581540.464656:0:20637:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff995e4eb3d800 from lustre-MDT0000 00000020:00000080:3.0:1788581540.464674:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581540.464826:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7284b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788581540.464832:0:15242:0:(genops.c:885:class_export_put()) final put ffff995d43bf5000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788581540.464834:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995d43bf5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788581540.464840:0:15242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788581540.465157:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7284a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788581540.465838:0:20637:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788581540.465844:0:20637:0:(genops.c:885:class_export_put()) final put ffff995d43bf3000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788581540.465847:0:20637:0:(genops.c:844:class_export_destroy()) destroying export ffff995d43bf3000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788581540.465856:0:20637:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788581540.465916:0:20637:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788581540.465922:0:20637:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788581540.465927:0:20637:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788581540.465930:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788581540.465934:0:20637:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788581540.465940:0:20637:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff995d43bf4000 611141c5-6f74-41ea-b38f-6fb1248f7899 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788581540.465946:0:20637:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff995e81dc99b8) has exports, disconnecting them 00000020:00080000:3.0:1788581540.465950:0:20637:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff995d43bf4000), last request at 1788581447 00000020:00000080:3.0:1788581540.465964:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30c65 00000020:00010000:3.0:1788581540.465970:0:20637:0:(genops.c:1921:obd_stale_export_put()) Put export ffff995d43bf4000: total 0 00000100:00080000:3.0:1788581540.465974:0:20637:0:(import.c:65:import_set_state_nolock()) ffff995d43bf1000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788581540.465995:0:20637:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995d43bf4000): rc 0 00000020:00080000:3.0:1788581540.466000:0:20637:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff995e81dc99b8) has no exports 00000100:00100000:3.0:1788581540.466060:0:17058:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff995e523bd200:17058] 2 exiting: rc = 0 00000100:00100000:3.0:1788581540.466157:0:17057:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff995d43345000:17057] 1 exiting: rc = 0 00000020:00010000:1.0:1788581540.466875:0:18596:0:(genops.c:1907:obd_stale_export_get()) Get export ffff995d43bf4000: total 0 00010000:00010000:1.0:1788581540.466918:0:18596:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff995d43bf4000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788581540.466948:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f980a00/0x50f0cc74b7b30ec6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b30ebf expref: 14 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581540.466967:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f981800/0x50f0cc74b7b30c73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b30c6c expref: 13 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581540.466976:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f980200/0x50f0cc74b7b30f60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b30f59 expref: 12 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581540.466987:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fb45800/0x50f0cc74b7b3115f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b31158 expref: 11 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581540.467001:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fb45200/0x50f0cc74b7b30d84 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b30d7d expref: 10 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581540.467011:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fa71400/0x50f0cc74b7b30ef0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b30ee9 expref: 9 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581540.467021:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fb44200/0x50f0cc74b7b3121c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b31215 expref: 8 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581540.467030:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e6f9d5400/0x50f0cc74b7b30e41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b30e3a expref: 7 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581540.467040:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fb44000/0x50f0cc74b7b30d92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b30d8b expref: 6 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581540.467051:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0ea00/0x50f0cc74b7b31238 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b31231 expref: 5 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581540.467082:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fb44600/0x50f0cc74b7b3122a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b31223 expref: 4 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581540.467095:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fa70800/0x50f0cc74b7b30da0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b30d99 expref: 3 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581540.467104:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fa71000/0x50f0cc74b7b30f8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50f0cc74b7b30f83 expref: 2 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581540.467113:0:18596:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff995d43bf4000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788581540.467126:0:18596:0:(genops.c:885:class_export_put()) final put ffff995d43bf4000/611141c5-6f74-41ea-b38f-6fb1248f7899 00010000:00010000:1.0:1788581540.467146:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581540.467148:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581540.467150:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581540.467176:0:17056:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff995d43344400:17056] 0 exiting: rc = 1 00000020:00000080:3.0:1788581540.467296:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995d43bf4000/611141c5-6f74-41ea-b38f-6fb1248f7899 for MGS 00000020:00000080:3.0:1788581540.467507:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d43bf1000 for MGS 00000100:00100000:3.0:1788581540.467539:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467556:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467564:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467569:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467575:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467580:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467585:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467591:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467597:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467602:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467608:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467614:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467620:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467625:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467631:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467636:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467641:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467646:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467651:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467657:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467662:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467667:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467673:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467679:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467684:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467826:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467837:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467843:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467848:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467853:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467868:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467874:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467880:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467886:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467892:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467897:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467911:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467916:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467921:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467927:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467932:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467937:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467942:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467948:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467953:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467958:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467963:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467969:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467974:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467979:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467984:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467989:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.467995:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.468000:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.468004:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.468009:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.468014:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.468019:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.468024:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.468029:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.468035:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.468039:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.468043:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581540.468048:0:20637:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788581540.472851:0:20637:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995d4385d120 - data ffff995e6b6f8af8/ffff995d43192400 00000020:01000000:3.0:1788581540.472987:0:20637:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995d43aced80 - data ffff995e6b5a0798/ffff995e77b6c000 00000020:00000080:3.0:1788581540.475140:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30c49 00000020:00000080:3.0:1788581540.475154:0:20637:0:(genops.c:885:class_export_put()) final put ffff995d43a83000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788581540.475233:0:20637:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e4eb3d800 from MGS, refs=2 00000020:01000004:3.0:1788581540.475237:0:20637:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e4eb3d800 2 00000020:01000004:3.0:1788581540.475285:0:20637:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff995e4eb3d800 from MGS 00000020:00000080:3.0:1788581540.475650:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788581540.475804:0:20637:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788581540.475809:0:20637:0:(genops.c:885:class_export_put()) final put ffff995d43a82000/MGS 00000020:00000080:3.0:1788581540.475812:0:20637:0:(genops.c:844:class_export_destroy()) destroying export ffff995d43a82000/MGS for MGS 00000020:01000000:3.0:1788581540.475820:0:20637:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788581540.475892:0:20637:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788581540.475896:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788581540.475902:0:20637:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788581540.475910:0:20637:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff995d43bf6000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788581540.475917:0:20637:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff995e81dc8000) has exports, disconnecting them 00000020:00080000:3.0:1788581540.475923:0:20637:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff995d43bf6000), last request at 1788581447 00000020:00000080:3.0:1788581540.475927:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30d4c 00000020:00080000:3.0:1788581540.475939:0:20637:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995d43bf6000): rc 0 00000020:00000080:3.0:1788581540.475944:0:20637:0:(genops.c:885:class_export_put()) final put ffff995d43bf6000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788581540.479646:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995d43a83000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788581540.482491:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995d43bf6000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788581540.484328:0:20637:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788581540.484337:0:20637:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788581540.484342:0:20637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788581540.484351:0:20637:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788581540.484382:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e4f27d800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788581540.484581:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581540.484589:0:20637:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788581540.484594:0:20637:0:(genops.c:885:class_export_put()) final put ffff995e6fad8800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788581540.484597:0:20637:0:(genops.c:844:class_export_destroy()) destroying export ffff995e6fad8800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788581540.484604:0:20637:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788581540.484707:0:20637:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e4eb3d800 1 00000020:00000080:1.0:1788581540.484727:0:20637:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30c3b 00000020:00000080:1.0:1788581540.484734:0:20637:0:(genops.c:885:class_export_put()) final put ffff995d43a83800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788581540.484744:0:20637:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788581540.484757:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995d43a83800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788581540.484766:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581540.484770:0:20637:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788581540.484775:0:20637:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff995e7a73b370) has no exports 00000020:00000080:1.0:1788581540.664801:0:20637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581540.664814:0:20637:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788581540.664820:0:20637:0:(genops.c:885:class_export_put()) final put ffff995e4eb38800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788581540.664824:0:20637:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4eb38800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788581540.664835:0:20637:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788581540.664961:0:20637:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff995e4eb3a800 00000020:02000400:1.0:1788581540.665013:0:20637:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788581541.443697:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581542.466580:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581543.247460:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184275328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581543.247529:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581543.247601:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184275328 00000100:00100000:1.0:1788581543.247608:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184275328 00000100:00100000:1.0:1788581543.247670:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788581543.247681:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184275328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788581543.247708:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788581543.247748:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184275328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581543.247756:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1788581543.247780:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581543.247815:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184275328:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788581543.490895:0:17823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788581543.491076:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788581543.773625:0:18566:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788581543.773639:0:18566:0:(genops.c:885:class_export_put()) final put ffff995d42ce3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788581543.776055:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995d42ce3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788581543.776180:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d42ce1800 for lustre-OST0000 00000100:00100000:0.0:1788581544.257542:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581544.257558:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184275456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581544.257627:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581544.257683:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184275456 00000100:00100000:0.0:1788581544.257690:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184275456 00000100:00100000:0.0:1788581544.257738:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788581544.257747:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184275456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788581544.257774:0:18573:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788581544.257824:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184275456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581544.257831:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788581544.257868:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581544.257902:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184275456:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788581544.259093:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788581544.259098:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788581544.259101:0:8:0:(import.c:65:import_set_state_nolock()) ffff995e7fa8e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788581544.259107:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 525 00000100:00080000:0.0:1788581544.259112:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788581544.259118:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff995e7fa8e800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581544.259139:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e45152300 x1875463184275712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788581544.259160:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788581544.259163:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788581544.259165:0:8:0:(import.c:65:import_set_state_nolock()) ffff995e44e1c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788581544.259168:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 525 00000100:00080000:0.0:1788581544.259170:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788581544.259174:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff995e44e1c000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581544.259185:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e45152a00 x1875463184275968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788581544.259193:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788581544.259195:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788581544.259197:0:8:0:(import.c:65:import_set_state_nolock()) ffff995e7a4d9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788581544.259200:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 525 00000100:00080000:0.0:1788581544.259209:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788581544.259213:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff995e7a4d9800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581544.259224:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e45151c00 x1875463184276096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788581544.259248:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1788581544.259422:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184275840:0@lo:400:kworker.0 00000100:00100000:3.0:1788581544.259483:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581544.259515:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581544.259522:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184275584:0@lo:400:kworker.0 00000400:00000100:3.0:1788581544.259559:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875463184275584 offset 0 length 224: 4 00000100:00100000:3.0:1788581544.259589:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184275712:0@lo:38:kworker.0 00000100:00100000:3.0:1788581544.259614:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581544.259632:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875463184275968:0@lo:38:kworker.0 00000100:00100000:3.0:1788581544.259654:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581544.259672:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875463184276096:0@lo:38:kworker.0 00000100:00100000:3.0:1788581544.259705:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581544.259744:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184275840 00000100:00100000:3.0:1788581544.259751:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184275840 00000100:00100000:3.0:1788581544.259788:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788581544.259796:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184275840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581544.259850:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184275840:12345-0@lo:400:kworker.0 Request processed in 55us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581544.259856:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788581544.259877:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184275712 00000100:00100000:3.0:1788581544.259881:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184275712 00000100:00100000:3.0:1788581544.259898:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788581544.259904:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875463184275712:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788581544.259921:0:17068:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1788581544.261337:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788581544.261344:0:8:0:(import.c:65:import_set_state_nolock()) ffff995e71e5e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788581544.261470:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 525 00000100:00080000:0.0:1788581544.261474:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788581544.261480:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff995e71e5e000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581544.261511:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e45150a80 x1875463184276352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788581544.261569:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184276224:0@lo:400:kworker.0 00000100:00100000:0.0:1788581544.261619:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581544.261651:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581544.261657:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184276480:0@lo:400:kworker.0 00000100:00100000:0.0:1788581544.261679:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581544.261716:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184275968 00000100:00100000:0.0:1788581544.261722:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184275968 00000100:00100000:0.0:1788581544.261748:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184276096 00000100:00100000:0.0:1788581544.261752:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184276096 00000100:00100000:0.0:1788581544.261760:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184276224 00000100:00100000:0.0:1788581544.261763:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184276224 00000100:00100000:0.0:1788581544.261998:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184276480 00000100:00100000:0.0:1788581544.262002:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184276480 00000100:00100000:0.0:1788581544.262022:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788581544.262030:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184276224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581544.262084:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184276224:12345-0@lo:400:kworker.0 Request processed in 54us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581544.262091:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788581544.262110:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788581544.262117:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184276480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581544.262144:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184276480:12345-0@lo:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581544.262149:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788581544.262161:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788581544.262165:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875463184275968:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788581544.262182:0:17065:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788581544.262210:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875463184275968:12345-0@lo:38:kworker.0 Request processed in 43us (2554us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788581544.262217:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788581544.262229:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788581544.262233:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875463184276096:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788581544.262242:0:17065:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788581544.262286:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875463184276096:12345-0@lo:38:kworker.0 Request processed in 50us (2579us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788581544.262292:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788581544.262312:0:17059:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788581544.262336:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff995e45150000 x1875463184276480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581544.262349:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184276480:0@lo:400:kworker.0 00010000:00080000:0.0:1788581544.262367:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff995e45151880 x1875463184276224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581544.262375:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184276224:0@lo:400:kworker.0 00000100:00100000:1.0:1788581544.265196:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184276352:0@lo:38:kworker.0 00000100:00100000:1.0:1788581544.265291:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788581544.265344:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e44e1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1788581544.265370:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184276352 00000100:00100000:2.0:1788581544.265379:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184276352 00000100:00100000:2.0:1788581544.265416:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788581544.265424:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4384d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875463184276352:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788581544.265444:0:17065:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788581544.265534:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4384d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875463184276352:12345-0@lo:38:kworker.0 Request processed in 110us (242us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788581544.265541:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1788581544.265909:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788581544.265914:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875463184275968:0@lo:38:kworker.0 00000100:00080000:1.0:1788581544.265932:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7a4d9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788581544.265936:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788581544.265939:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875463184276096:0@lo:38:kworker.0 00000100:00080000:1.0:1788581544.265970:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e71e5e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788581544.265973:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788581544.265976:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184276352:0@lo:38:kworker.0 00000100:00100000:1.0:1788581544.266027:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184275840:0@lo:400:kworker.0 00000100:00100000:3.0:1788581544.279874:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875463184275712:12345-0@lo:38:kworker.0 Request processed in 19962us (20252us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788581544.279887:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788581544.280714:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7fa8e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788581544.280724:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788581544.280729:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184275712:0@lo:38:kworker.0 00000020:01000004:2.0:1788581544.369638:0:20838:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788581544.390949:0:20838:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788581544.391005:0:20838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30e41 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.391961:0:20838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30e41 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.391970:0:20838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30e41 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.391977:0:20838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30e41 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.392005:0:20838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581544.392155:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581544.392162:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30e41 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581544.392169:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d5c00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581544.392173:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30e41 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581544.392182:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b30e41 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581544.392206:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b30e41 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581544.392211:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788581544.392214:0:17052:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00010000:00010000:1.0:1788581544.392249:0:17052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30e41 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581544.392283:0:17052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581544.392314:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30e41 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581544.392324:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581544.392325:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581544.392327:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581544.392379:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581544.392399:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184276608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581544.392463:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581544.393103:0:20838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d5c00/0x50f0cc74b7b30e3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30e41 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581544.393109:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184276608 00000100:00100000:1.0:1788581544.393116:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184276608 10000000:01000000:2.0:1788581544.393120:0:20838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 10000000:01000000:2.0:1788581544.393134:0:20838:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788581544.393161:0:20838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581544.393165:0:20838:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1788581544.393166:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788581544.393172:0:20838:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788581544.393173:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45151880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3621:x1875463184276608:12345-0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788581544.393177:0:20838:0:(import.c:65:import_set_state_nolock()) ffff995e44e1c000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00020000:1.0:1788581544.393179:0:17048:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788581544 with bad export cookie 5832386319115029605 00000100:00080000:2.0:1788581544.393182:0:20838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581544.393184:0:20838:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788581544.393186:0:20838:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788581544.396218:0:20838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30da0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.396238:0:20838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30da0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.396246:0:20838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30da0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.396267:0:20838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30da0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.396291:0:20838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581544.396297:0:20838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3115f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.396304:0:20838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b3115f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.396311:0:20838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b3115f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.396335:0:20838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b3115f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.396433:0:20838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788581544.396443:0:20838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31238 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.396461:0:20838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31238 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.396468:0:20838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b31238 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.396475:0:20838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b31238 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581544.402144:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788581544.402159:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30da0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581544.402170:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581544.402175:0:18596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30da0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581544.402185:0:18596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b30da0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581544.402192:0:18596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b30da0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581544.402198:0:18596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788581544.402201:0:18596:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1788581544.402267:0:18596:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30da0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581544.402274:0:18596:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581544.402305:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30da0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581544.402329:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4200/0x50f0cc74b7b30d99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30da0 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581544.402346:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581544.402350:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b3115f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581544.402357:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70e00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581544.402360:0:18596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b3115f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581544.402367:0:18596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b3115f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581544.402373:0:18596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b3115f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581544.402379:0:18596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788581544.402382:0:18596:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788581544.402384:0:18596:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788581544.402400:0:18596:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b3115f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581544.402405:0:18596:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581544.402422:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b3115f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581544.402428:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fa70e00/0x50f0cc74b7b31158 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b3115f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581544.402462:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581544.402467:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b31238 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581544.402473:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980000 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581544.402476:0:18596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b31238 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581544.402483:0:18596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b31238 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581544.402490:0:18596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b31238 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581544.402495:0:18596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788581544.402498:0:18596:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788581544.402510:0:18596:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b31238 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581544.402516:0:18596:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581544.402522:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b31238 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581544.402529:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581544.402532:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581544.402534:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581544.402556:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581544.402574:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184276736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581544.402635:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581544.402708:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184276864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581544.402734:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581544.402752:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581544.402758:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184276992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581544.402789:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581544.402819:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184276736 00000100:00100000:0.0:1788581544.402826:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184276736 00000100:00100000:0.0:1788581544.402864:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184276864 00000100:00100000:0.0:1788581544.402867:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184276864 00000100:00100000:0.0:1788581544.402875:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184276992 00000100:00100000:0.0:1788581544.402877:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184276992 00000100:00100000:0.0:1788581544.402886:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788581544.402894:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45150a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3620:x1875463184276736:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788581544.402900:0:17050:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788581544 with bad export cookie 5832386319115029605 00000100:00100000:0.0:1788581544.402939:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45150a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3620:x1875463184276736:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (304us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788581544.402945:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788581544.402962:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788581544.402966:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4f1f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3618:x1875463184276864:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788581544.402969:0:17050:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788581544 with bad export cookie 5832386319115029605 00000100:00100000:0.0:1788581544.402996:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4f1f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3618:x1875463184276864:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (261us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788581544.403001:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788581544.403023:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788581544.403027:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45151c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3618:x1875463184276992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788581544.403032:0:17050:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788581544 with bad export cookie 5832386319115029605 00000100:00100000:0.0:1788581544.403055:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45151c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3618:x1875463184276992:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (265us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788581544.403067:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788581544.403100:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788581544.403104:0:3618:0:(import.c:65:import_set_state_nolock()) ffff995e4eb3d000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788581544.403108:0:3618:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.103@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1788581544.406063:0:20838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788581544.406078:0:20838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f980000/0x50f0cc74b7b31231 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b31238 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581544.406099:0:20838:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788581544.406221:0:20838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30d92 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.406231:0:20838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30d92 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.406238:0:20838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30d92 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.406277:0:20838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30d92 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581544.406295:0:20838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788581544.406299:0:20838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1788581544.406303:0:20838:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788581544.406340:0:20838:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788581544.406345:0:20838:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788581544.406350:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581544.406357:0:20838:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788581544.406364:0:20838:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff995d4389f000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788581544.406371:0:20838:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff995e7a4de000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788581544.406376:0:20838:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff995d42c00000) has exports, disconnecting them 00000020:00080000:2.0:1788581544.406380:0:20838:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff995d4389f000), last request at 1788581544 00000020:00000080:2.0:1788581544.406386:0:20838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30fb4 00000100:00080000:2.0:1788581544.406403:0:20838:0:(import.c:65:import_set_state_nolock()) ffff995d4389f800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788581544.406442:0:20838:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995d4389f000): rc 0 00000020:00000080:2.0:1788581544.406445:0:20838:0:(genops.c:885:class_export_put()) final put ffff995d4389f000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788581544.406468:0:20838:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff995e7a4de000), last request at 1788581544 00000020:00000080:2.0:1788581544.406471:0:20838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30f1a 00000100:00080000:2.0:1788581544.406476:0:20838:0:(import.c:65:import_set_state_nolock()) ffff995e7a4dd000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788581544.406487:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995d4389f000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788581544.406535:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d4389f800 for lustre-MDT0001 00000020:00080000:2.0:1788581544.406548:0:20838:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e7a4de000): rc 0 00000020:00000080:2.0:1788581544.406550:0:20838:0:(genops.c:885:class_export_put()) final put ffff995e7a4de000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788581544.406559:0:20838:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffabf141debae0 00000020:00000080:2.0:1788581544.406569:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7a4de000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788581544.406602:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e7a4dd000 for lustre-MDT0001 00000100:00080000:2.0:1788581544.406621:0:20838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581544.406630:0:20838:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff995e550ace00 x1875463184273408/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788581554 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581544.406640:0:20838:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788581544.409984:0:20838:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788581544.409995:0:20838:0:(import.c:65:import_set_state_nolock()) ffff995e7fa8e800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788581544.410328:0:20838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788581544.410333:0:20838:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788581544.410348:0:20838:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788581544.410404:0:20838:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788581544.410429:0:20838:0:(import.c:65:import_set_state_nolock()) ffff995e7fa8b800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788581544.410443:0:20838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788581544.410445:0:20838:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 3 00010000:00010000:1.0:1788581544.410461:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581544.410469:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30d92 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581544.410478:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70000 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581544.410482:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30d92 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581544.410490:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b30d92 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581544.410507:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b30d92 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581544.410513:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788581544.410516:0:17052:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788581544.410518:0:17052:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788581544.410585:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788581544.410745:0:20838:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788581544.410880:0:20838:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788581544.410893:0:20838:0:(import.c:65:import_set_state_nolock()) ffff995d43a55000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788581544.410935:0:20838:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff995d42c00000) has no exports 00000100:00080000:2.0:1788581544.411388:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:3.0:1788581544.413394:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581544.418122:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184277120:0@lo:9:umount.0 00000100:00100000:3.0:1788581544.418201:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581544.418234:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184277248:0@lo:9:umount.0 00000100:00100000:3.0:1788581544.418296:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581544.418347:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184277120 00000100:00100000:3.0:1788581544.418355:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184277120 00000100:00100000:3.0:1788581544.418395:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184277248 00000100:00100000:3.0:1788581544.418399:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184277248 00000100:00100000:3.0:1788581544.418418:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788581544.418427:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875463184277120:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788581544.418480:0:18571:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30f44 00000100:00080000:3.0:1788581544.418490:0:18571:0:(import.c:65:import_set_state_nolock()) ffff995e7a6d4800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788581544.418531:0:18571:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788581544.418673:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3617:x1875463184277120:12345-0@lo:9:umount.0 Request processed in 246us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581544.418681:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788581544.418708:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788581544.418714:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875463184277248:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788581544.418725:0:18571:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30fd0 00000100:00080000:3.0:1788581544.418731:0:18571:0:(import.c:65:import_set_state_nolock()) ffff995d4389d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788581544.418751:0:18571:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1788581544.418845:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3617:x1875463184277248:12345-0@lo:9:umount.0 Request processed in 120us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581544.418851:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1788581544.418875:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788581544.418902:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7fa8b800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788581544.418914:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788581544.418916:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788581544.418919:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184277120:0@lo:9:umount.0 00000100:00080000:3.0:1788581544.418930:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d43a55000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788581544.418937:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788581544.418939:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788581544.418941:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184277248:0@lo:9:umount.0 00010000:00010000:3.0:1788581544.418966:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788581544.424653:0:3618:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.103@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788581544.424658:0:3618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788581544.424667:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e45152d80 x1875463184275584/t0(0) o400->MGC192.168.203.103@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788581560 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581544.424747:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995d44071f80 x1875463184276608/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788581560 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581544.424754:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e45150000 x1875463184276736/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788581560 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581544.424760:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e45152300 x1875463184276864/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788581560 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581544.424766:0:3618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e45152680 x1875463184276992/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788581560 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788581544.424772:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788581544.424774:0:3618:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788581544.424775:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788581544.424799:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184275584:0@lo:400:kworker.0 00000100:00080000:2.0:1788581544.425694:0:3620:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff995e4eb3d000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:0.0:1788581544.425694:0:3618:0:(import.c:65:import_set_state_nolock()) ffff995e4eb3d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788581544.425703:0:3618:0:(import.c:510:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 433 00000100:00080000:0.0:1788581544.425712:0:3618:0:(import.c:624:import_select_connection()) MGC192.168.203.103@tcp: import ffff995e4eb3d000 using connection 192.168.203.103@tcp/0@lo 00010000:00010000:1.0:1788581544.425724:0:17052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30d92 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581544.425736:0:17052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788581544.425739:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:3621:1875463184276608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581544.425753:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30d92 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581544.425766:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fa70000/0x50f0cc74b7b30d8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50f0cc74b7b30d92 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581544.425767:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e45152a00 x1875463184277504/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788581544.425779:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581544.425788:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:611141c5-6f74-41ea-b38f-6fb1248f7899:0:1875463184277376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581544.425805:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:611141c5-6f74-41ea-b38f-6fb1248f7899:3617:1875463184277504:0@lo:250:ptlrpcd_00_00.0 00010000:00010000:1.0:1788581544.425812:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581544.425816:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581544.425818:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788581544.425862:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875463184277504 offset 0 length 520: 4 00000100:00100000:2.0:1788581544.425898:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184273408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788581544.425914:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:611141c5-6f74-41ea-b38f-6fb1248f7899:3620:1875463184276736:0@lo:103:ldlm_bl.0 00000400:00000100:1.0:1788581544.426925:0:17048:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875463184276608 offset 224 length 224: 4 00000100:00100000:1.0:1788581544.426946:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45151880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3621:x1875463184276608:12345-0@lo:103:ldlm_bl.0 Request processed in 33770us (34481us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788581544.426957:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788581544.426971:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184276864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581544.426984:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:611141c5-6f74-41ea-b38f-6fb1248f7899:3618:1875463184276992:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788581544.433459:0:20838:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff995d42c00000) has no exports 00000020:01000000:3.0:1788581544.498941:0:20838:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995d4385d9c0 - data ffff995e586f5288/ffff995e7561c800 00000020:01000000:3.0:1788581544.499104:0:20838:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995d43ace4e0 - data ffff995e6b454360/ffff995e726df400 00000001:00000004:3.0:1788581544.508508:0:20838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00010000:00010000:3.0:1788581544.513466:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788581544.541577:0:20838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788581544.541585:0:20838:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788581544.541592:0:20838:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788581544.543101:0:20838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788581544.543106:0:20838:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1788581544.543122:0:20838:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788581544.543136:0:20838:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788581544.543503:0:17804:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788581544.543508:0:17804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:2.0:1788581544.543516:0:17804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788581544.544013:0:20838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788581544.544016:0:20838:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1788581544.544031:0:20838:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788581544.544032:0:20838:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788581544.544410:0:17807:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788581544.544419:0:17807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1788581544.544426:0:17807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788581544.545614:0:20838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30dae 00000020:00000080:1.0:1788581544.545623:0:20838:0:(genops.c:885:class_export_put()) final put ffff995e45130000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788581544.546453:0:20838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30dc3 00000020:00000080:1.0:1788581544.546459:0:20838:0:(genops.c:885:class_export_put()) final put ffff995e7fa31800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788581544.546552:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e45130000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788581544.546605:0:20838:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788581544.546610:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581544.546618:0:20838:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788581544.546622:0:20838:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff995d41c019b8) has no exports 00000004:01000000:1.0:1788581544.546819:0:20838:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788581544.546826:0:20838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30e17 00000020:00000080:1.0:1788581544.546830:0:20838:0:(genops.c:885:class_export_put()) final put ffff995e43203800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788581544.547052:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa31800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788581544.547110:0:20838:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788581544.547114:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581544.547119:0:20838:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788581544.547122:0:20838:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff995e47873370) has no exports 00000020:00000080:1.0:1788581544.547127:0:20838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30e10 00000020:00000080:1.0:1788581544.547130:0:20838:0:(genops.c:885:class_export_put()) final put ffff995d43a53000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788581544.547190:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e43203800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1788581544.547693:0:20838:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788581544.547697:0:20838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788581544.547700:0:20838:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1788581544.547705:0:20838:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788581544.547707:0:20838:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788581544.547787:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995d43a53000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788581544.547904:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581544.547910:0:20838:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788581544.547914:0:20838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30e02 00000020:00000080:1.0:1788581544.547919:0:20838:0:(genops.c:885:class_export_put()) final put ffff995e524d8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788581544.547938:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d43a55000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788581544.547944:0:8:0:(genops.c:885:class_export_put()) final put ffff995e524d8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788581544.547946:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e524d8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1788581544.547949:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788581544.548077:0:20838:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788581544.548081:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581544.548098:0:20838:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788581544.548100:0:20838:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff995e7fa03370) has no exports 00000020:00000080:1.0:1788581544.548105:0:20838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30df4 00000020:00000080:1.0:1788581544.548109:0:20838:0:(genops.c:885:class_export_put()) final put ffff995e7fa8e000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788581544.548127:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e524d8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:1.0:1788581544.548628:0:20838:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788581544.548631:0:20838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788581544.548635:0:20838:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788581544.548639:0:20838:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788581544.548640:0:20838:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788581544.548740:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa8e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788581544.548938:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581544.548943:0:20838:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788581544.548953:0:20838:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788581544.548958:0:20838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30de6 00000020:00000080:1.0:1788581544.548963:0:20838:0:(genops.c:885:class_export_put()) final put ffff995d43a54000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788581544.548966:0:20838:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788581544.548969:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581544.548972:0:20838:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788581544.548975:0:20838:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff995e478719b8) has no exports 00000020:00000080:1.0:1788581544.548978:0:20838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30ddf 00000020:00000080:1.0:1788581544.548981:0:20838:0:(genops.c:885:class_export_put()) final put ffff995e7fa8d800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788581544.549506:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e7fa8b800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788581544.549514:0:8:0:(genops.c:885:class_export_put()) final put ffff995d43a52000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788581544.549516:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995d43a52000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788581544.549525:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788581544.549580:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995d43a54000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788581544.549585:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa8d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788581544.551372:0:20838:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788581544.551380:0:20838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581544.551383:0:20838:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788581544.551389:0:20838:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788581544.551432:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581544.551440:0:20838:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788581544.551461:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581544.551463:0:20838:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788581544.551467:0:20838:0:(genops.c:885:class_export_put()) final put ffff995e7fa36000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788581544.551471:0:20838:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa36000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788581544.551477:0:20838:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788581544.551874:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e7fa8e800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788581544.551882:0:8:0:(genops.c:885:class_export_put()) final put ffff995e7fa8b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788581544.551884:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa8b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788581544.551887:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788581544.552337:0:20838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30dca 00000020:00000080:3.0:1788581544.552344:0:20838:0:(genops.c:885:class_export_put()) final put ffff995e7fa33800/lustre-MDD0001_UUID 00000020:01000000:3.0:1788581544.552358:0:20838:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788581544.552363:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581544.552365:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa33800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788581544.552369:0:20838:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788581544.552373:0:20838:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff995d42c019b8) has no exports 00000020:00000080:3.0:1788581544.552396:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788581544.552400:0:20838:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788581544.552403:0:20838:0:(genops.c:885:class_export_put()) final put ffff995d4328d800/lustre-MDD0001_UUID 00000020:00000080:3.0:1788581544.552405:0:20838:0:(genops.c:844:class_export_destroy()) destroying export ffff995d4328d800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788581544.552409:0:20838:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788581544.552594:0:20838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30dd1 00000020:00000080:3.0:1788581544.552606:0:20838:0:(genops.c:885:class_export_put()) final put ffff995e7fa36800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1788581544.552616:0:20838:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e7a4de800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788581544.552619:0:20838:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e7a4de800 2 00000020:01000004:3.0:1788581544.552622:0:20838:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff995e7a4de800 from lustre-MDT0001 00000020:00000080:3.0:1788581544.552643:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788581544.552647:0:20838:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788581544.552650:0:20838:0:(genops.c:885:class_export_put()) final put ffff995d43288000/lustre-MDT0001_UUID 00000020:00000080:3.0:1788581544.552652:0:20838:0:(genops.c:844:class_export_destroy()) destroying export ffff995d43288000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788581544.552658:0:20838:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788581544.552684:0:20838:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788581544.552687:0:20838:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788581544.552690:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788581544.552693:0:20838:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788581544.552710:0:20838:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff995e4f10c800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788581544.552715:0:20838:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff995e7a690000) has exports, disconnecting them 00000020:00000080:2.0:1788581544.552872:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa36800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00080000:3.0:1788581544.553173:0:20838:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff995e4f10c800), last request at 1788581461 00000020:00000080:3.0:1788581544.553180:0:20838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30e4f 00000020:00080000:3.0:1788581544.553193:0:20838:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e4f10c800): rc 0 00000020:00000080:3.0:1788581544.553197:0:20838:0:(genops.c:885:class_export_put()) final put ffff995e4f10c800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788581544.553232:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4f10c800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1788581544.556378:0:20838:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1788581544.556387:0:20838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581544.556412:0:20838:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788581544.556419:0:20838:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788581544.556465:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e44e1c000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788581544.556696:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581544.556705:0:20838:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1788581544.556709:0:20838:0:(genops.c:885:class_export_put()) final put ffff995e524de800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788581544.556713:0:20838:0:(genops.c:844:class_export_destroy()) destroying export ffff995e524de800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788581544.556718:0:20838:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1788581544.556782:0:20838:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e7a4de800 1 00000020:00000080:2.0:1788581544.556788:0:20838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30d76 00000020:00000080:2.0:1788581544.556794:0:20838:0:(genops.c:885:class_export_put()) final put ffff995e7fa37000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1788581544.556803:0:20838:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1788581544.556812:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fa37000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788581544.556821:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581544.556826:0:20838:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788581544.556830:0:20838:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff995d42c04d28) has no exports 00000020:00000080:0.0:1788581544.625069:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581544.625088:0:20838:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788581544.625093:0:20838:0:(genops.c:885:class_export_put()) final put ffff995e7a4d9000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788581544.625096:0:20838:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7a4d9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788581544.625106:0:20838:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788581544.625195:0:20838:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff995e7a4da000 00000020:01000000:0.0:1788581544.625214:0:20838:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788581544.625217:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788581544.625222:0:20838:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788581544.625226:0:20838:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff995e81dccd28) has no exports 00000100:00100000:3.0:1788581544.625372:0:17065:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff995d42221800:17065] 2 exiting: rc = 0 00000100:00100000:1.0:1788581544.625556:0:20048:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff995d43b0c000:20048] 3 exiting: rc = 0 00000100:00100000:1.0:1788581544.625637:0:17064:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff995d42220000:17064] 1 exiting: rc = 0 00000100:00100000:3.0:1788581544.626571:0:17063:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff995d41799600:17063] 0 exiting: rc = 1 00000100:00100000:0.0:1788581544.626698:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626705:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626711:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626715:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626720:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626725:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626731:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626735:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626740:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626745:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626751:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626755:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626760:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626765:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626770:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626775:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626779:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626784:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626789:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626859:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626875:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626880:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626885:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626890:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626895:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626900:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626905:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626910:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626914:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626918:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626923:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626927:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626932:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626937:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626942:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626946:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626951:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626956:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626960:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626965:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626969:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626975:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626980:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626985:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626989:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626994:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.626999:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.627538:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.627545:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.627549:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.627555:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.627561:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.627567:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.627639:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.627645:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.627661:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.627666:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.627671:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.627676:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.627681:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.627686:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.627691:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.627696:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.627702:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634537:0:17067:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff995d41799200:17067] 1 exiting: rc = 0 00000100:00100000:1.0:1788581544.634610:0:17066:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff995e81fe6800:17066] 0 exiting: rc = 1 00000100:00100000:0.0:1788581544.634776:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634785:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634791:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634798:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634804:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634809:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634815:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634842:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634849:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634854:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634860:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634865:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634871:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634879:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634885:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634890:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634894:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634898:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634903:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634908:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634913:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634918:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634923:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634927:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634932:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634949:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634954:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634959:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634963:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634968:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634972:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634977:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634982:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634986:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634990:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634994:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.634998:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635003:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635120:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635129:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635133:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635138:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635143:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635148:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635152:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635157:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635163:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635168:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635174:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635180:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635185:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635190:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635195:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635200:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635206:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635211:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635216:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635221:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635227:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635232:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635244:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635250:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635281:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.635287:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581544.636022:0:17806:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff995e7a683800:17806] 2 exiting: rc = 0 00000100:00100000:0.0:1788581544.636201:0:17069:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff995e81fe6200:17069] 1 exiting: rc = 0 00000100:00100000:0.0:1788581544.636504:0:17068:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff995e6f8b9e00:17068] 0 exiting: rc = 1 00000100:00100000:0.0:1788581544.636590:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.636604:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.636689:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.636717:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.636728:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.636740:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.636753:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.636766:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.636776:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.636785:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.636796:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.636808:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637196:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637213:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637226:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637470:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637480:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637485:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637491:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637500:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637505:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637511:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637516:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637521:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637527:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637533:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637538:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637558:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637565:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637580:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637585:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637591:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637596:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637601:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637607:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637682:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637690:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637696:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637703:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637724:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637732:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637738:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637745:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637752:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637758:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637764:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637770:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637776:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637782:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637788:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637794:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637815:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637896:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637904:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637910:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637916:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637922:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637927:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637932:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637938:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637943:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637949:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637954:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.637960:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581544.648722:0:17070:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff995d41798a00:17070] 0 exiting: rc = 1 00000100:00100000:3.0:1788581544.649151:0:17071:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff995e7a662200:17071] 1 exiting: rc = 0 00000100:00100000:0.0:1788581544.649212:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649221:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649227:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649233:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649242:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649248:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649303:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649309:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649314:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649319:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649394:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649402:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649407:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649412:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649418:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649424:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649429:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649436:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649442:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649449:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649455:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649464:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649475:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649484:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649494:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649502:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649509:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649515:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649522:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649529:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649535:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649541:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649548:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649554:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649562:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649581:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649587:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649593:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649598:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649602:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649607:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649819:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649826:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649846:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649852:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649857:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649862:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649867:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649872:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649878:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649883:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649887:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649892:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649897:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649902:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649907:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649912:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649917:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649922:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649928:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649933:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649938:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649942:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.649947:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581544.650540:0:17073:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff995e75563000:17073] 1 exiting: rc = 0 00000100:00100000:3.0:1788581544.651419:0:17072:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff995e75562800:17072] 0 exiting: rc = 1 00000100:00100000:0.0:1788581544.651942:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.651950:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.651956:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.651960:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.651966:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.651976:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.651993:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.651998:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652002:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652007:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652012:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652017:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652022:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652027:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652032:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652037:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652042:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652047:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652052:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652057:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652062:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652067:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652073:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652078:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652082:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652086:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652091:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652096:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652101:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652106:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652111:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652116:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652121:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652126:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652131:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652136:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652141:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652146:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652151:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652156:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652162:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652176:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652181:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652186:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652191:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652196:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652201:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652205:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652215:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652219:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652224:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652228:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652232:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652237:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652242:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652246:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652392:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652401:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652406:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652412:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652417:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652422:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652427:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.652432:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581544.655012:0:17074:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff995e75562600:17074] 0 exiting: rc = 1 00000100:00100000:1.0:1788581544.655122:0:17075:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff995e75562200:17075] 1 exiting: rc = 0 00000100:00100000:0.0:1788581544.655230:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655237:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655242:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655247:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655856:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655866:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655871:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655876:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655880:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655886:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655891:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655895:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655912:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655917:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655922:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655927:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655932:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655937:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655942:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655947:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655952:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655957:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655962:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655966:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655971:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655976:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655982:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655986:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655991:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.655995:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656000:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656004:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656009:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656014:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656019:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656024:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656029:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656034:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656039:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656045:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656050:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656055:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656060:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656065:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656070:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656074:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656079:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656091:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656096:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656102:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656107:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656112:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656117:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656122:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656127:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656131:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656137:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656141:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656146:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656150:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656154:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656159:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656164:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.656168:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581544.657159:0:17076:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff995d41e56e00:17076] 0 exiting: rc = 1 00000100:00100000:3.0:1788581544.657785:0:17077:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff995d4321aa00:17077] 1 exiting: rc = 0 00000100:00100000:3.0:1788581544.658008:0:17078:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff995d4321b800:17078] 2 exiting: rc = 0 00000100:00100000:0.0:1788581544.658203:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658210:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658216:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658221:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658227:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658233:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658239:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658245:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658314:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658321:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658328:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658334:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658340:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658346:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658351:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658367:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658373:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658379:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658397:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658403:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658409:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658415:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658422:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658428:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658434:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658441:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658447:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658452:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658458:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658463:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658469:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658475:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658495:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658503:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658508:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658514:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658520:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658525:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658531:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658537:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658544:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658551:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658558:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.658563:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.660828:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.660906:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.660913:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.660920:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.660926:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.660932:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.660939:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.660945:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.660950:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.660968:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.660974:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.660980:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.661005:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.661012:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.661019:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.661024:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.661030:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.661035:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.661041:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581544.661046:0:20838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788581544.674076:0:20838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581544.674089:0:20838:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788581544.674095:0:20838:0:(genops.c:885:class_export_put()) final put ffff995e477ed800/MDS_uuid 00000020:00000080:0.0:1788581544.674099:0:20838:0:(genops.c:844:class_export_destroy()) destroying export ffff995e477ed800/MDS_uuid for MDS 00000020:01000000:0.0:1788581544.674109:0:20838:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788581544.674231:0:20838:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788581545.539602:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581546.562435:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581547.587111:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788581548.159415:0:21038:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788581548.180390:0:21038:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788581548.180449:0:21038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b30ee9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30ef0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581548.180465:0:21038:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b30ee9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30ef0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581548.180473:0:21038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b30ee9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30ef0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581548.180481:0:21038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b30ee9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30ef0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581548.180521:0:21038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788581548.180527:0:21038:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788581548.180549:0:21038:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581548.180554:0:21038:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788581548.180559:0:21038:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788581548.180565:0:21038:0:(import.c:65:import_set_state_nolock()) ffff995e7a4d9800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788581548.180569:0:21038:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581548.180570:0:21038:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788581548.180573:0:21038:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788581548.181399:0:21038:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788581548.181404:0:21038:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788581548.181409:0:21038:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788581548.181430:0:21038:0:(import.c:65:import_set_state_nolock()) ffff995e7fb21000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788581548.181626:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581548.181635:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b30ee9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30ef0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581548.181653:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4a00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581548.181657:0:18596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b30ee9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30ef0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581548.181666:0:18596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b30ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b30ef0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581548.181672:0:18596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b30ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b30ef0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581548.181678:0:18596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788581548.181680:0:18596:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788581548.181683:0:18596:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788581548.181695:0:18596:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff995e4eb3d000 00010000:00010000:3.0:1788581548.181698:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b30ee9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b30ef0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581548.181705:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4a00/0x50f0cc74b7b30ee9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b30ef0 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581548.181716:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581548.181718:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581548.181719:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581548.182002:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875463184277632:0@lo:39:umount.0 00000400:00000100:0.0:1788581548.182054:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463184277632 offset 0 length 224: 4 00010000:00010000:2.0:1788581548.609441:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788581549.380243:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 611141c5-6f74-41ea-b38f-6fb1248f7899->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788581549.380270:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 611141c5-6f74-41ea-b38f-6fb1248f7899->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788581549.380273:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788581549.380276:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788581549.380280:0:8:0:(import.c:65:import_set_state_nolock()) ffff995e71e5e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788581549.380288:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 530 00000100:00080000:0.0:1788581549.380294:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788581549.380303:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff995e71e5e000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581549.380359:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e45153b80 x1875463184277760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788581549.380723:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184277760:0@lo:38:kworker.0 00000400:00000100:3.0:1788581549.380776:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463184277760 offset 0 length 520: 4 00000100:00100000:1.0:1788581549.380940:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184277888:0@lo:400:kworker.0 00000400:00000100:1.0:1788581549.380966:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463184277888 offset 0 length 224: 4 00010000:00010000:1.0:1788581549.633490:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788581549.890877:0:18566:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788581549.890884:0:18566:0:(genops.c:885:class_export_put()) final put ffff995e7a6d3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788581549.890945:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7a6d3000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788581549.891020:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e7a6d4800 for lustre-OST0000 00000001:00100000:3.0:1788581549.891051:0:19386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788581549.891056:0:19386:0:(genops.c:885:class_export_put()) final put ffff995d4389b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788581549.891087:0:15242:0:(genops.c:844:class_export_destroy()) destroying export ffff995d4389b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788581549.891107:0:15242:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995d4389d000 for lustre-OST0001 00010000:00010000:3.0:1788581550.658189:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581551.681444:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581552.705459:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581553.729435:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788581554.497411:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 611141c5-6f74-41ea-b38f-6fb1248f7899->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788581554.497418:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 611141c5-6f74-41ea-b38f-6fb1248f7899->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788581554.497421:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788581554.497425:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788581554.497692:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184278016:0@lo:400:kworker.0 00000400:00000100:1.0:1788581554.497744:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463184278016 offset 0 length 224: 4 00000100:00100000:0.0:1788581554.498487:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581544/real 1788581544] req@ffff995e45152a00 x1875463184277504/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788581554 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581554.498523:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995e45152a00 x1875463184277504/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788581554 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788581554.498539:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4eb3d000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788581554.498562:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788581554.498567:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:611141c5-6f74-41ea-b38f-6fb1248f7899:3617:1875463184277504:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1788581554.498782:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) 611141c5-6f74-41ea-b38f-6fb1248f7899->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788581554.498801:0:15242:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788581554.498804:0:15242:0:(import.c:65:import_set_state_nolock()) ffff995e4eb3d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581554.498816:0:15242:0:(import.c:510:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 530 00000100:00080000:2.0:1788581554.498821:0:15242:0:(import.c:589:import_select_connection()) MGC192.168.203.103@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788581554.498827:0:15242:0:(import.c:624:import_select_connection()) MGC192.168.203.103@tcp: import ffff995e4eb3d000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581554.498850:0:15242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e550aea00 x1875463184278144/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788581554.498889:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788581554.498893:0:15242:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788581554.499065:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:611141c5-6f74-41ea-b38f-6fb1248f7899:3617:1875463184278144:0@lo:250:kworker.0 00000400:00000100:0.0:1788581554.499099:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875463184278144 offset 0 length 520: 4 00010000:00010000:3.0:1788581554.754074:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581555.778037:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581556.801499:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581557.825526:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581558.593383:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581548/real 1788581548] req@ffff995e550ace00 x1875463184277632/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788581558 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581558.593415:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995e550ace00 x1875463184277632/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788581558 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788581558.593436:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e7fb21000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788581558.593461:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875463184277632:0@lo:39:umount.0 00000100:00080000:2.0:1788581558.594139:0:21038:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788581558.594145:0:21038:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788581558.594149:0:21038:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788581558.595070:0:21038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b30ebf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30ec6 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581558.595085:0:21038:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b30ebf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30ec6 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581558.595092:0:21038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b30ebf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30ec6 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581558.595099:0:21038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b30ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30ec6 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581558.595124:0:21038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581558.595130:0:21038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa71c00/0x50f0cc74b7b31223 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3122a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581558.595136:0:21038:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa71c00/0x50f0cc74b7b31223 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b3122a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581558.595142:0:21038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa71c00/0x50f0cc74b7b31223 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b3122a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581558.595148:0:21038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e7fa71c00/0x50f0cc74b7b31223 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b3122a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581558.595172:0:21038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788581558.595177:0:21038:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788581558.595198:0:21038:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788581558.595202:0:21038:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788581558.595207:0:21038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581558.595212:0:21038:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788581558.595216:0:21038:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff995d41c00000) has no exports 00000020:00080000:2.0:1788581558.595237:0:21038:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff995d41c00000) has no exports 00010000:00010000:3.0:1788581558.595317:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581558.595326:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b30ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30ec6 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581558.595334:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4800 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581558.595338:0:18596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b30ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30ec6 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581558.595347:0:18596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b30ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b30ec6 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581558.595354:0:18596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b30ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b30ec6 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581558.595360:0:18596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788581558.595362:0:18596:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788581558.595365:0:18596:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788581558.595380:0:18596:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff995e4eb3d000 00010000:00010000:3.0:1788581558.595392:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b30ebf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b30ec6 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581558.595399:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4800/0x50f0cc74b7b30ebf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b30ec6 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581558.595413:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581558.595416:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e7fa71c00/0x50f0cc74b7b31223 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b3122a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581558.595429:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71c00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581558.595432:0:18596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa71c00/0x50f0cc74b7b31223 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b3122a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581558.595439:0:18596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fa71c00/0x50f0cc74b7b31223 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b3122a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581558.595453:0:18596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa71c00/0x50f0cc74b7b31223 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b3122a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581558.595459:0:18596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788581558.595461:0:18596:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788581558.595463:0:18596:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788581558.595468:0:18596:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff995e4eb3d000 00010000:00010000:3.0:1788581558.595472:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e7fa71c00/0x50f0cc74b7b31223 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b3122a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581558.595477:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fa71c00/0x50f0cc74b7b31223 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b3122a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581558.595486:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581558.595487:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581558.595489:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581558.595547:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788581558.596931:0:21038:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995d4385df00 - data ffff995e6b6c8360/ffff995e7561e800 00000020:01000000:2.0:1788581558.597058:0:21038:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995d4385d3c0 - data ffff995e58021af8/ffff995e44988000 00100000:10000000:3.0:1788581558.615795:0:21038:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788581558.633071:0:21038:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30ed4 00000020:00000080:2.0:1788581558.633083:0:21038:0:(genops.c:885:class_export_put()) final put ffff995e7fb22800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788581558.633098:0:21038:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e7fa35800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788581558.633101:0:21038:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e7fa35800 2 00000020:01000004:2.0:1788581558.633104:0:21038:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff995e7fa35800 from lustre-OST0000 00000020:00000080:0.0:1788581558.633153:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fb22800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788581558.633834:0:21038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581558.633844:0:21038:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788581558.633848:0:21038:0:(genops.c:885:class_export_put()) final put ffff995e7fb27800/lustre-OST0000_UUID 00000020:00000080:2.0:1788581558.633851:0:21038:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fb27800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788581558.633858:0:21038:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788581558.633915:0:21038:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788581558.636107:0:21038:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788581558.636120:0:21038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581558.636131:0:21038:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788581558.636138:0:21038:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff995e7fb25800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788581558.636145:0:21038:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff995e6f8b0000) has exports, disconnecting them 00000020:00080000:2.0:1788581558.636150:0:21038:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff995e7fb25800), last request at 1788581476 00000020:00000080:2.0:1788581558.636155:0:21038:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30efe 00000020:00080000:2.0:1788581558.636214:0:21038:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e7fb25800): rc 0 00000020:00000080:2.0:1788581558.636219:0:21038:0:(genops.c:885:class_export_put()) final put ffff995e7fb25800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788581558.636307:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fb25800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788581558.641449:0:21038:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788581558.641458:0:21038:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788581558.641463:0:21038:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788581558.641469:0:21038:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788581558.641628:0:21038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581558.641637:0:21038:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788581558.641643:0:21038:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788581558.641653:0:21038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581558.641657:0:21038:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788581558.641664:0:21038:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff995e7fb23000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788581558.641671:0:21038:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff995d41c04d28) has exports, disconnecting them 00000020:00080000:1.0:1788581558.641676:0:21038:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff995e7fb23000), last request at 1788581476 00000020:00000080:1.0:1788581558.641680:0:21038:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30f13 00000020:00080000:1.0:1788581558.641693:0:21038:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e7fb23000): rc 0 00000020:00000080:1.0:1788581558.641698:0:21038:0:(genops.c:885:class_export_put()) final put ffff995e7fb23000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788581558.642481:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e7a4d9800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788581558.642494:0:8:0:(genops.c:885:class_export_put()) final put ffff995e7a6d0800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788581558.642497:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7a6d0800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788581558.642503:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788581558.642565:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fb23000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788581558.643336:0:21038:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788581558.643342:0:21038:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788581558.643346:0:21038:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788581558.643352:0:21038:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788581558.643375:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e7fb21000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788581558.643532:0:21038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581558.643541:0:21038:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1788581558.643545:0:21038:0:(genops.c:885:class_export_put()) final put ffff995e7fb23800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1788581558.643547:0:21038:0:(genops.c:844:class_export_destroy()) destroying export ffff995e7fb23800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1788581558.643552:0:21038:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788581558.643595:0:21038:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e7fa35800 1 00000020:00000080:0.0:1788581558.643601:0:21038:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30eb1 00000020:00000080:0.0:1788581558.643607:0:21038:0:(genops.c:885:class_export_put()) final put ffff995e4f10a000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788581558.643614:0:21038:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788581558.643622:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4f10a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788581558.643630:0:21038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788581558.643634:0:21038:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788581558.643650:0:21038:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff995e6f8b4d28) has no exports 00000020:00000080:0.0:1788581558.708712:0:21038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581558.708727:0:21038:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788581558.708732:0:21038:0:(genops.c:885:class_export_put()) final put ffff995d42c2c800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788581558.708740:0:21038:0:(genops.c:844:class_export_destroy()) destroying export ffff995d42c2c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788581558.708773:0:21038:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788581558.708896:0:21038:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff995e7fa34000 00000020:02000400:0.0:1788581558.708948:0:21038:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788581558.849660:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788581559.627987:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 611141c5-6f74-41ea-b38f-6fb1248f7899->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788581559.627997:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 611141c5-6f74-41ea-b38f-6fb1248f7899->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788581559.628000:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788581559.628003:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788581559.628544:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581559.628565:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184278272:0@lo:400:kworker.0 00000400:00000100:1.0:1788581559.628616:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463184278272 offset 0 length 224: 4 00010000:00010000:0.0:1788581559.874109:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581560.898745:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581561.925491:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788581562.173611:0:21240:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788581562.182426:0:21240:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788581562.183139:0:21240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4c00/0x50f0cc74b7b30f83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30f8a expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581562.183180:0:21240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4c00/0x50f0cc74b7b30f83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30f8a expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581562.183188:0:21240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4c00/0x50f0cc74b7b30f83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30f8a expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581562.183196:0:21240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4c00/0x50f0cc74b7b30f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30f8a expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581562.183222:0:21240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788581562.183228:0:21240:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788581562.183270:0:21240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788581562.183280:0:21240:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e45153b80 x1875463184277760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788581569 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581562.183298:0:21240:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788581562.183304:0:21240:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788581562.183310:0:21240:0:(import.c:65:import_set_state_nolock()) ffff995e71e5e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788581562.183315:0:21240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788581562.183318:0:21240:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e45153b80 x1875463184277760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788581569 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581562.183325:0:21240:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788581562.183327:0:21240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00010000:00010000:2.0:1788581562.183614:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581562.183621:0:18596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4c00/0x50f0cc74b7b30f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30f8a expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581562.183631:0:18596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f9d4c00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788581562.183635:0:18596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4c00/0x50f0cc74b7b30f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30f8a expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581562.183644:0:18596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4c00/0x50f0cc74b7b30f83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b30f8a expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581562.183653:0:18596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4c00/0x50f0cc74b7b30f83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b30f8a expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581562.183658:0:18596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788581562.183661:0:18596:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788581562.183663:0:18596:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788581562.183754:0:18596:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff995e4eb3d000 00010000:00010000:2.0:1788581562.183758:0:18596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4c00/0x50f0cc74b7b30f83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b30f8a expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581562.183777:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e6f9d4c00/0x50f0cc74b7b30f83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b30f8a expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581562.183788:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581562.183790:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581562.183792:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581562.183835:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184277760:0@lo:38:kworker.0 00000100:00080000:2.0:1788581562.187031:0:21240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788581562.187047:0:21240:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e45153100 x1875463184277888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581565 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581562.187077:0:21240:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e45152680 x1875463184278016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581570 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581562.187093:0:21240:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e550adc00 x1875463184278272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581575 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581562.187100:0:21240:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788581562.187142:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875463184277888:0@lo:400:kworker.0 00000100:00100000:2.0:1788581562.187202:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184278272:0@lo:400:kworker.0 00000100:00100000:2.0:1788581562.187217:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184278016:0@lo:400:kworker.0 00000100:00080000:2.0:1788581562.187241:0:21240:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788581562.187283:0:21240:0:(import.c:65:import_set_state_nolock()) ffff995e4f0d8800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788581562.187343:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875463184278400:0@lo:39:umount.0 00000400:00000100:3.0:1788581562.187387:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463184278400 offset 0 length 224: 4 00010000:00010000:2.0:1788581562.945686:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581563.971107:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788581564.738133:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) 611141c5-6f74-41ea-b38f-6fb1248f7899->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788581564.738144:0:15242:0:(pinger.c:247:ptlrpc_pinger_process_import()) 611141c5-6f74-41ea-b38f-6fb1248f7899->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788581564.993471:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581566.017637:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581567.041622:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581568.065696:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581569.089604:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581569.345560:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581554/real 1788581554] req@ffff995e550aea00 x1875463184278144/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788581569 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581569.345595:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995e550aea00 x1875463184278144/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788581569 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788581569.345616:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4eb3d000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581569.345641:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788581569.345645:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:611141c5-6f74-41ea-b38f-6fb1248f7899:3617:1875463184278144:0@lo:250:kworker.0 00000100:00080000:2.0:1788581569.345841:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) 611141c5-6f74-41ea-b38f-6fb1248f7899->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788581569.345847:0:15242:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788581569.345850:0:15242:0:(import.c:65:import_set_state_nolock()) ffff995e4eb3d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581569.345855:0:15242:0:(import.c:510:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 540 00000100:00080000:2.0:1788581569.345860:0:15242:0:(import.c:589:import_select_connection()) MGC192.168.203.103@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788581569.345866:0:15242:0:(import.c:624:import_select_connection()) MGC192.168.203.103@tcp: import ffff995e4eb3d000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581569.345899:0:15242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e550ad880 x1875463184278528/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788581569.346238:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:611141c5-6f74-41ea-b38f-6fb1248f7899:3617:1875463184278528:0@lo:250:kworker.0 00000400:00000100:3.0:1788581569.346305:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875463184278528 offset 0 length 520: 4 00010000:00010000:3.0:1788581570.117175:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581571.137708:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581572.161810:0:17051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581572.417394:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581562/real 1788581562] req@ffff995e550adc00 x1875463184278400/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788581572 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581572.417427:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995e550adc00 x1875463184278400/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788581572 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788581572.417447:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4f0d8800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788581572.417470:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875463184278400:0@lo:39:umount.0 00000100:00080000:2.0:1788581572.417614:0:21240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788581572.417619:0:21240:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788581572.417624:0:21240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788581572.418718:0:21240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa71200/0x50f0cc74b7b30f59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b30f60 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581572.418735:0:21240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa71200/0x50f0cc74b7b30f59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b30f60 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581572.418742:0:21240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa71200/0x50f0cc74b7b30f59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30f60 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581572.418749:0:21240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e7fa71200/0x50f0cc74b7b30f59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b30f60 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581572.418774:0:21240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581572.418783:0:21240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70200/0x50f0cc74b7b31215 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3121c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581572.418810:0:21240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70200/0x50f0cc74b7b31215 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b3121c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581572.418817:0:21240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e7fa70200/0x50f0cc74b7b31215 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b3121c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581572.418824:0:21240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff995e7fa70200/0x50f0cc74b7b31215 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50f0cc74b7b3121c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581572.418846:0:21240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788581572.418851:0:21240:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788581572.418874:0:21240:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788581572.418878:0:21240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788581572.418883:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581572.418888:0:21240:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788581572.418893:0:21240:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff995e47870000) has no exports 00000020:00080000:2.0:1788581572.418916:0:21240:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff995e47870000) has no exports 00010000:00010000:3.0:1788581572.419163:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581572.419171:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e7fa71200/0x50f0cc74b7b30f59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30f60 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581572.419178:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581572.419182:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa71200/0x50f0cc74b7b30f59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b30f60 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581572.419203:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fa71200/0x50f0cc74b7b30f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b30f60 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581572.419210:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa71200/0x50f0cc74b7b30f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b30f60 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581572.419216:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788581572.419218:0:17052:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788581572.419221:0:17052:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788581572.419234:0:17052:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff995e4eb3d000 00010000:00010000:3.0:1788581572.419237:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e7fa71200/0x50f0cc74b7b30f59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b30f60 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581572.419244:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fa71200/0x50f0cc74b7b30f59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b30f60 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581572.419287:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581572.419291:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e7fa70200/0x50f0cc74b7b31215 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b3121c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581572.419297:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581572.419300:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa70200/0x50f0cc74b7b31215 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50f0cc74b7b3121c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581572.419307:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fa70200/0x50f0cc74b7b31215 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b3121c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581572.419313:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa70200/0x50f0cc74b7b31215 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b3121c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581572.419338:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788581572.419340:0:17052:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788581572.419342:0:17052:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788581572.419349:0:17052:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff995e4eb3d000 00010000:00010000:3.0:1788581572.419352:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e7fa70200/0x50f0cc74b7b31215 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b3121c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581572.419357:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fa70200/0x50f0cc74b7b31215 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b3121c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581572.419370:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581572.419372:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581572.419374:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581572.420179:0:18596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788581572.440709:0:21240:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995d43011240 - data ffff995e5801b510/ffff995e7f669400 00000020:01000000:2.0:1788581572.440834:0:21240:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff995e81f29120 - data ffff995e586980d8/ffff995d41e28000 00100000:10000000:2.0:1788581572.447547:0:21240:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788581572.462667:0:21240:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30f6e 00000020:00000080:3.0:1788581572.462680:0:21240:0:(genops.c:885:class_export_put()) final put ffff995d4389d800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788581572.463078:0:21240:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e50dc7800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788581572.463083:0:21240:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e50dc7800 2 00000020:01000004:3.0:1788581572.463086:0:21240:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff995e50dc7800 from lustre-OST0001 00000020:00000080:3.0:1788581572.463111:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788581572.463120:0:21240:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788581572.463123:0:21240:0:(genops.c:885:class_export_put()) final put ffff995d4389e800/lustre-OST0001_UUID 00000020:00000080:3.0:1788581572.463126:0:21240:0:(genops.c:844:class_export_destroy()) destroying export ffff995d4389e800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788581572.463132:0:21240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788581572.463445:0:21240:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 611141c5-6f74-41ea-b38f-6fb1248f7899->MGS 00010000:00010000:3.0:1788581572.463462:0:21240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fa70600/0x50f0cc74b7b30d7d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b30d84 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581572.463474:0:21240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fa70600/0x50f0cc74b7b30d7d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b30d84 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581572.463497:0:21240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788581572.463499:0:21240:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788581572.463503:0:21240:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788581572.463518:0:21240:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff995e4eb3d000 00010000:00010000:3.0:1788581572.463521:0:21240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fa70600/0x50f0cc74b7b30d7d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b30d84 expref: -99 pid: 17795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581572.463537:0:21240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x50f0cc74b7b30c73 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581572.463543:0:21240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x50f0cc74b7b30c73 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581572.463548:0:21240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788581572.463550:0:21240:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788581572.463552:0:21240:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788581572.463559:0:21240:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff995e4eb3d000 00010000:00010000:3.0:1788581572.463562:0:21240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e7fb45c00/0x50f0cc74b7b30c6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x50f0cc74b7b30c73 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788581572.463578:0:21240:0:(import.c:65:import_set_state_nolock()) ffff995e4eb3d000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788581572.463582:0:21240:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788581572.463584:0:21240:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788581572.463585:0:21240:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788581572.463588:0:21240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788581572.463599:0:21240:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff995e550ad880 x1875463184278528/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788581589 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788581572.463693:0:21240:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788581572.463696:0:21240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:1.0:1788581572.470576:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:611141c5-6f74-41ea-b38f-6fb1248f7899:3617:1875463184278528:0@lo:250:kworker.0 10000000:01000000:1.0:1788581572.470671:0:21240:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788581572.470684:0:21240:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30c57 00000020:00000080:1.0:1788581572.470710:0:21240:0:(genops.c:885:class_export_put()) final put ffff995e477e9800/611141c5-6f74-41ea-b38f-6fb1248f7899 00000020:01000000:1.0:1788581572.470727:0:21240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.103@tcp (flags='') 00000020:00000080:1.0:1788581572.470755:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581572.470764:0:21240:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.103@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788581572.470769:0:21240:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff995e7a7399b8) has no exports 10000000:01000000:1.0:1788581572.470788:0:17060:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788581572.470867:0:21240:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.103@tcp: client import never connected 00000100:00080000:1.0:1788581572.470871:0:21240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788581572.470874:0:21240:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788581572.470878:0:21240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788581572.470880:0:21240:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788581572.471169:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581572.471176:0:21240:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.103@tcp (uuid 611141c5-6f74-41ea-b38f-6fb1248f7899) 00000020:01000000:1.0:1788581572.471183:0:21240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788581572.471186:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581572.471202:0:21240:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788581572.471208:0:21240:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff995e4f0dc800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788581572.471213:0:21240:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff995e6f8b19b8) has exports, disconnecting them 00000020:00080000:1.0:1788581572.471218:0:21240:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff995e4f0dc800), last request at 1788581491 00000020:00000080:1.0:1788581572.471222:0:21240:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30f98 00000020:00080000:1.0:1788581572.471232:0:21240:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995e4f0dc800): rc 0 00000020:00000080:1.0:1788581572.471236:0:21240:0:(genops.c:885:class_export_put()) final put ffff995e4f0dc800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788581572.472370:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995d4389d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788581572.472449:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e477e9800/611141c5-6f74-41ea-b38f-6fb1248f7899 for MGC192.168.203.103@tcp 00000020:00000080:0.0:1788581572.472463:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e4eb3d000 for MGC192.168.203.103@tcp 00000020:00000080:0.0:1788581572.472470:0:8:0:(genops.c:885:class_export_put()) final put ffff995e4eb39800/611141c5-6f74-41ea-b38f-6fb1248f7899 00000020:00000080:0.0:1788581572.472473:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4eb39800/611141c5-6f74-41ea-b38f-6fb1248f7899 for MGC192.168.203.103@tcp 00000020:01000000:0.0:1788581572.472477:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.103@tcp (611141c5-6f74-41ea-b38f-6fb1248f7899) 00000020:00000080:0.0:1788581572.473198:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4f0dc800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788581572.473770:0:21240:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788581572.473775:0:21240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788581572.473780:0:21240:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788581572.473785:0:21240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788581572.473959:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e71e5e000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788581572.474304:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581572.474313:0:21240:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788581572.474317:0:21240:0:(genops.c:885:class_export_put()) final put ffff995e4f0db800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788581572.474320:0:21240:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4f0db800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788581572.474325:0:21240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788581572.474557:0:21240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788581572.474561:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788581572.474567:0:21240:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788581572.474573:0:21240:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff995d4389c000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788581572.474580:0:21240:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff995e47874d28) has exports, disconnecting them 00000020:00080000:0.0:1788581572.474591:0:21240:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff995d4389c000), last request at 1788581491 00000020:00000080:0.0:1788581572.474595:0:21240:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30fad 00000020:00080000:0.0:1788581572.474609:0:21240:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff995d4389c000): rc 0 00000020:00000080:0.0:1788581572.474614:0:21240:0:(genops.c:885:class_export_put()) final put ffff995d4389c000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788581572.474805:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995d4389c000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788581572.541485:0:21240:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788581572.541526:0:21240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788581572.541530:0:21240:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788581572.541537:0:21240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788581572.541608:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff995e4f0d8800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788581572.541715:0:17051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788581572.542161:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788581572.542429:0:18596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788581572.542633:0:17047:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff995e47af5000:17047] 1 exiting: rc = 0 00000100:00100000:1.0:1788581572.542725:0:17046:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff995e75630000:17046] 0 exiting: rc = 1 00000100:00100000:1.0:1788581572.542779:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.544034:0:20093:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff995e7b448c00:20093] 3 exiting: rc = 0 00000100:00100000:1.0:1788581572.544367:0:17048:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff995d417ea200:17048] 0 exiting: rc = 1 00000100:00100000:1.0:1788581572.544460:0:17049:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff995d43abce00:17049] 1 exiting: rc = 0 00000100:00100000:1.0:1788581572.544543:0:17050:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff995d4216c600:17050] 2 exiting: rc = 0 00000100:00100000:3.0:1788581572.547925:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.547935:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.547941:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.547947:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.547952:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.547958:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.547964:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.547970:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.547974:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.547979:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.547983:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.547989:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.547994:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.547999:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548005:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548010:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548132:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548145:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548151:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548156:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548161:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548165:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548170:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548176:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548181:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548187:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548206:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548211:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548217:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548222:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548232:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548238:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548243:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548329:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548341:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548346:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548350:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548355:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548360:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548365:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548380:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548387:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548393:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548398:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548404:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548409:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548414:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548420:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548425:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548429:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548434:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548439:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548444:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548448:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548453:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548458:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548463:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548468:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548473:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548480:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548485:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548499:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548504:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.548510:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788581572.549719:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788581572.549730:0:21240:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788581572.549737:0:21240:0:(genops.c:885:class_export_put()) final put ffff995d43899000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788581572.549742:0:21240:0:(genops.c:844:class_export_destroy()) destroying export ffff995d43899000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788581572.549746:0:21240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788581572.549795:0:21240:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e50dc7800 1 00000020:00000080:3.0:1788581572.549801:0:21240:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x50f0cc74b7b30f52 00000020:00000080:3.0:1788581572.549807:0:21240:0:(genops.c:885:class_export_put()) final put ffff995d4389a000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788581572.549820:0:21240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788581572.549832:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff995d4389a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788581572.549842:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788581572.549848:0:21240:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788581572.549851:0:21240:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff995e7a694d28) has no exports 00000020:00000080:2.0:1788581572.602001:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581572.602015:0:21240:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788581572.602029:0:21240:0:(genops.c:885:class_export_put()) final put ffff995e50dc0800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788581572.602043:0:21240:0:(genops.c:844:class_export_destroy()) destroying export ffff995e50dc0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788581572.602055:0:21240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788581572.602919:0:21240:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff995e50dc3800 00000020:01000000:2.0:1788581572.602943:0:21240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788581572.602949:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581572.602954:0:21240:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788581572.602967:0:21240:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff995e7a693370) has no exports 00000020:00000080:2.0:1788581572.602988:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581572.602995:0:21240:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788581572.602998:0:21240:0:(genops.c:885:class_export_put()) final put ffff995e4f108000/OSS_uuid 00000020:00000080:2.0:1788581572.603000:0:21240:0:(genops.c:844:class_export_destroy()) destroying export ffff995e4f108000/OSS_uuid for OSS 00000020:01000000:2.0:1788581572.603004:0:21240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788581572.603632:0:17059:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788581572.603844:0:19467:0:(service.c:3183:ptlrpc_main()) ll_ost00_005: service thread [ffff995e729aa000:19467] 5 exiting: rc = 0 00000100:00100000:3.0:1788581572.603918:0:19464:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff995d417ea400:19464] 4 exiting: rc = 0 00000100:00100000:3.0:1788581572.603970:0:18570:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff995e44bbc600:18570] 0 exiting: rc = 1 00000100:00100000:2.0:1788581572.604902:0:18572:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff995e45735200:18572] 2 exiting: rc = 0 00000100:00100000:2.0:1788581572.604965:0:18571:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff995e45735c00:18571] 1 exiting: rc = 0 00000100:00100000:2.0:1788581572.605358:0:19099:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff995d4214e000:19099] 3 exiting: rc = 0 00000100:00100000:1.0:1788581572.605581:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.605589:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.605595:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.605599:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.605604:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.605608:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.605612:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.605617:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.605622:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.605626:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.605631:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.605636:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.605642:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.605647:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.605965:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.605975:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606152:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606160:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606165:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606170:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606175:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606180:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606186:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606191:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606196:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606202:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606207:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606213:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606218:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606224:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606230:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606235:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606240:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606245:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606249:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606299:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606304:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606309:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606314:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606318:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606323:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606327:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606331:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606336:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606341:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606345:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606350:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606354:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606359:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606364:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606374:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606379:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606385:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606453:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606458:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606463:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606468:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606473:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606479:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606484:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606489:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606494:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606499:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.606572:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581572.609909:0:18574:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff995e45735e00:18574] 1 exiting: rc = 0 00000100:00100000:2.0:1788581572.610588:0:18573:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff995e45735800:18573] 0 exiting: rc = 1 00000100:00100000:1.0:1788581572.610852:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610859:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610864:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610869:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610874:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610880:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610900:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610904:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610909:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610915:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610920:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610925:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610930:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610935:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610940:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610945:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610949:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610954:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610959:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610963:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610969:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610974:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610979:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610985:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610991:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.610998:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611009:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611027:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611033:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611038:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611044:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611049:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611055:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611228:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611234:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611240:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611245:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611251:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611326:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611331:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611335:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611359:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611364:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611369:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611374:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611379:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611384:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611389:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611394:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611399:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611403:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611412:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.611418:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.612313:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.612320:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.612325:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.612330:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.612334:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.612338:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.612344:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.612349:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.612353:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.612358:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.612364:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581572.613740:0:18576:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff995e7a67c200:18576] 1 exiting: rc = 0 00000100:00100000:2.0:1788581572.613748:0:18575:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff995e45734600:18575] 0 exiting: rc = 1 00000100:00100000:3.0:1788581572.613897:0:18577:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff995e7a67ce00:18577] 2 exiting: rc = 0 00000100:00100000:1.0:1788581572.613986:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614001:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614009:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614014:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614030:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614036:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614042:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614048:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614053:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614067:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614082:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614089:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614108:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614114:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614120:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614126:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614132:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614137:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614143:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614148:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614155:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614161:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614168:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614174:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614180:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614187:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614192:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614198:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614204:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614209:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614215:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614220:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614226:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614231:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614279:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614288:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614293:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614298:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614303:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614308:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614314:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614319:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614325:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614330:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614335:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614340:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614345:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614359:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614364:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614370:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.614375:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.617300:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.617310:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.617319:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.617325:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.617330:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.617339:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.617345:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.617373:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.617384:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.617389:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.617404:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.617414:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.617420:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628052:0:18578:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff995e7a67dc00:18578] 0 exiting: rc = 1 00000100:00100000:1.0:1788581572.628591:0:18579:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff995e661e9600:18579] 1 exiting: rc = 0 00000100:00100000:3.0:1788581572.628675:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628684:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628689:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628694:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628699:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628703:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628708:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628714:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628718:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628723:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628728:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628747:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628752:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628756:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628761:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628765:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628770:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628776:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628781:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628786:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628791:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628797:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628802:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628807:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628812:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628818:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628823:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628828:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628833:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628838:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628843:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628848:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628853:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628858:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628862:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628866:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628871:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628876:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628881:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628886:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628890:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628896:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628901:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628906:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628911:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628916:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628929:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628939:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628945:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628950:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628954:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628958:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628963:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628968:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628972:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628976:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628981:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628987:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628991:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.628996:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.629001:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.629005:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.629009:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.629015:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581572.630825:0:18580:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff995e661e9800:18580] 0 exiting: rc = 1 00000100:00100000:2.0:1788581572.630958:0:18581:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff995e661e8c00:18581] 1 exiting: rc = 0 00000100:00100000:3.0:1788581572.631303:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631312:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631318:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631325:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631331:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631337:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631342:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631348:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631374:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631381:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631387:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631392:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631398:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631403:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631409:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631414:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631420:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631438:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631444:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631450:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631469:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631476:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631482:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631489:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631495:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631500:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631506:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631512:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631527:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631532:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631538:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631544:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631564:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631571:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631577:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631583:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631590:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631596:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631603:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631608:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631613:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631619:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631625:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631631:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631652:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631671:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631676:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631682:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631689:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631695:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631700:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631707:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631720:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631726:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631731:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631737:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631757:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631764:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631769:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631775:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631781:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631786:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631792:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581572.631797:0:21240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788581572.641905:0:21240:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788581592.595562:0:22007:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788581602.464531:0:22606:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788581602.464535:0:22606:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788581602.464537:0:22606:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788581602.464638:0:22606:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff995e7f798800 00000020:01000004:3.0:1788581602.464651:0:22606:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788581602.464657:0:22606:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788581602.464669:0:22606:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff995d41c03370) 00000020:00000080:3.0:1788581602.464680:0:22606:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788581602.532598:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788581602.533090:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788581602.534793:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1788581602.535088:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1788581602.535307:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1788581602.535525:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788581602.538118:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788581602.538555:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788581602.538956:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788581602.539360:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788581602.539670:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788581602.540068:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788581602.540302:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788581602.540805:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788581602.542841:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788581602.544361:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788581602.544680:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788581602.545042:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788581602.545231:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788581602.545984:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788581602.546177:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788581602.546697:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788581602.547178:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788581602.547428:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788581602.547688:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788581602.548116:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788581602.548364:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788581602.548602:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788581602.548986:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788581602.549236:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788581602.549565:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788581602.549978:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788581602.550175:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788581602.550386:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788581602.550577:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788581602.550976:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788581602.551171:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788581602.551433:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788581602.551626:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788581602.551994:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788581602.552189:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788581602.552392:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788581602.552577:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788581602.553713:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788581602.554452:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788581602.555182:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788581602.555547:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788581602.559237:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1788581602.560128:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1788581602.560456:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1788581602.561123:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1788581602.561421:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1788581602.561686:0:22606:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:0.0:1788581602.563160:0:22606:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788581602.563542:0:22606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788581602.563550:0:22606:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788581602.563560:0:22606:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b3155d 00000020:01000004:2.0:1788581602.563566:0:22606:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788581602.563571:0:22606:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788581602.563576:0:22606:0:(tgt_mount.c:101:server_register_mount()) register mount ffff995e7f798800 from MGS 00000020:01000004:2.0:1788581602.563579:0:22606:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788581602.563590:0:22606:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff995e7a694d28) 00000020:00000080:2.0:1788581602.563600:0:22606:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788581602.563654:0:22606:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e7f798800 from MGS, refs=2 00080000:01000000:2.0:1788581602.563658:0:22606:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788581602.563836:0:22606:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b3156b 00000100:00100000:2.0:1788581602.564057:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788581602.564186:0:22606:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788581602.564192:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788581602.565121:0:22606:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788581602.565129:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788581602.566028:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581602.566178:0:22606:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788581602.566183:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788581602.568631:0:22606:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788581602.568643:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788581602.569314:0:22606:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788581602.569322:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788581602.571370:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581602.571374:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581602.571376:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581602.571826:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581602.571829:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581602.571831:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581602.573680:0:22606:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788581602.579778:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788581602.581215:0:22606:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788581602.584649:0:22619:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788581602.584694:0:22606:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788581602.584806:0:22606:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788581602.586078:0:22606:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788581602.586504:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581602.586672:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788581602.586678:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788581602.587579:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788581602.587587:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788581602.589013:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788581602.589026:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788581602.591434:0:22606:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788581602.591456:0:22606:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.103@tcp' 00000020:01000004:1.0:1788581602.591458:0:22606:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788581602.591499:0:22606:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.103@tcp (typ=mgc) 00000020:00000080:1.0:1788581602.591512:0:22606:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.103@tcp (ffff995e47874d28) 00000020:00000080:1.0:1788581602.591526:0:22606:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788581602.591601:0:22606:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995d41d5a800@MGC192.168.203.103@tcp: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1788581602.591743:0:22606:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.103@tcp-0 is initialized 00000040:01000000:1.0:1788581602.591841:0:22606:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788581602.592305:0:22623:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788581602.595284:0:22624:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788581602.596023:0:22606:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.103@tcp (uuid a361c037-f8ee-420d-b76d-dbdb9328e15d) 00000020:00000080:1.0:1788581602.596045:0:22606:0:(genops.c:1385:class_connect()) connect: client a361c037-f8ee-420d-b76d-dbdb9328e15d, cookie 0x50f0cc74b7b31579 00000100:00080000:1.0:1788581602.596062:0:22606:0:(import.c:510:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788581602.596068:0:22606:0:(import.c:624:import_select_connection()) MGC192.168.203.103@tcp: import ffff995d41d5a800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581602.596104:0:22606:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e766ea680 x1875463184278656/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581602.596152:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a361c037-f8ee-420d-b76d-dbdb9328e15d:3617:1875463184278656:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788581602.596219:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788581602.596294:0:22606:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a361c037-f8ee-420d-b76d-dbdb9328e15d->MGS 00000020:01000004:1.0:1788581602.596313:0:22606:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788581602.596334:0:22606:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788581602.596347:0:22606:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff995e47870000) 00000020:00000080:1.0:1788581602.596358:0:22606:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788581602.597764:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184278656 00000100:00100000:3.0:1788581602.597775:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184278656 00000100:00100000:3.0:1788581602.597815:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581602.597823:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3617:x1875463184278656:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788581602.597909:0:22620:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a361c037-f8ee-420d-b76d-dbdb9328e15d@0@lo t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:3.0:1788581602.597938:0:22620:0:(genops.c:1385:class_connect()) connect: client a361c037-f8ee-420d-b76d-dbdb9328e15d, cookie 0x50f0cc74b7b31587 00000100:00080000:3.0:1788581602.598070:0:22620:0:(import.c:65:import_set_state_nolock()) ffff995e7f698800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581602.598167:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+5:3617:x1875463184278656:12345-0@lo:250:mount.lustre.0 Request processed in 343us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581602.598186:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581602.598294:0:3617:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788581602.598304:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.103@tcp: connect to target with instance 0 00000100:00080000:3.0:1788581602.598311:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788581602.598316:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788581602.598319:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d41d5a800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788581602.598322:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788581602.598338:0:3617:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788581602.598344:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a361c037-f8ee-420d-b76d-dbdb9328e15d:3617:1875463184278656:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788581602.609111:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581602.609702:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788581602.609708:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788581602.610668:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788581602.610677:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788581602.611731:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788581602.611741:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788581602.615402:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788581602.615631:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788581602.615637:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788581602.618654:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788581602.618790:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788581602.673066:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788581602.673283:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788581602.673291:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788581602.674618:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788581602.674628:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788581602.675353:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581602.675532:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788581602.675537:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788581602.676194:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788581602.676202:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788581602.680601:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581602.681037:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788581602.681044:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788581602.682114:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788581602.682123:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788581602.682724:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581602.683087:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788581602.683093:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788581602.683886:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788581602.683992:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788581602.711206:0:22606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788581602.712219:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788581602.712225:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788581602.714127:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788581602.714139:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788581602.715597:0:22606:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788581602.715609:0:22606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788581602.716601:0:22606:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788581602.716627:0:22606:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788581602.716632:0:22606:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788581602.716722:0:22606:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788581602.716774:0:22606:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.103@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788581602.716778:0:22606:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788581602.716779:0:22606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788581602.716781:0:22606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581602.716782:0:22606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581602.716783:0:22606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581602.716784:0:22606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581602.716785:0:22606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788581602.716787:0:22606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788581602.716788:0:22606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581602.716790:0:22606:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788581602.716792:0:22606:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788581602.716794:0:22606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788581602.716795:0:22606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788581602.716797:0:22606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581602.716797:0:22606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581602.716799:0:22606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581602.716800:0:22606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581602.716801:0:22606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788581602.716802:0:22606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788581602.716803:0:22606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581602.716804:0:22606:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788581602.716836:0:22606:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788581602.716855:0:22606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43836680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184278784:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788581602.717146:0:22606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581602.717191:0:22606:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788581602.717838:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184278784 00000100:00100000:0.0:1788581602.717847:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184278784 00000100:00100000:0.0:1788581602.718101:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788581602.718112:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+5:22606:x1875463184278784:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788581602.718162:0:22622:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788581602.718165:0:22622:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788581602.718167:0:22622:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788581602.718683:0:22642:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788581602.719201:0:22622:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1788581602.721423:0:22643:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788581602.721430:0:22643:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788581602.721433:0:22643:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788581602.721436:0:22643:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788581602.721734:0:22643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788581602.722117:0:22622:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788581602.722129:0:22622:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788581602.724956:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+5:22606:x1875463184278784:12345-0@lo:253:mount.lustre.0 Request processed in 6838us (7802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581602.724974:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581602.725151:0:22606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43836680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184278784:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788581602.725165:0:22606:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788581602.725168:0:22606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788581602.725170:0:22606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788581602.725171:0:22606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581602.725172:0:22606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581602.725173:0:22606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581602.725174:0:22606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581602.725175:0:22606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788581602.725176:0:22606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788581602.725178:0:22606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581602.725190:0:22606:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788581602.725212:0:22606:0:(tgt_mount.c:101:server_register_mount()) register mount ffff995e7f798800 from lustre-MDT0000 10000000:01000000:3.0:1788581602.725243:0:22606:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788581602.725246:0:22606:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788581602.725250:0:22606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff995e47874d28 10000000:01000000:3.0:1788581602.725366:0:22606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788581602.725374:0:22606:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff995e47874d28 from 1 10000000:01000000:3.0:1788581602.725378:0:22606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788581602.725529:0:22606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b3158e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581602.725540:0:22606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b3158e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581602.725550:0:22606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b3158e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581602.725570:0:22606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43836680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184278912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788581602.725845:0:22606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581602.725989:0:22606:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581602.735623:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184278912 00000100:00100000:0.0:1788581602.735638:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184278912 00000100:00100000:0.0:1788581602.735706:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581602.735716:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+5:22606:x1875463184278912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581602.735731:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581602.735753:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995d43272600/0x50f0cc74b7b31595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b3158e expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581602.735778:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43272600/0x50f0cc74b7b31595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b3158e expref: 6 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581602.735788:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995d43272600/0x50f0cc74b7b31595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b3158e expref: 6 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581602.735797:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272600, rc 0) 00000100:00100000:0.0:1788581602.735868:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+6:22606:x1875463184278912:12345-0@lo:101:mount.lustre.0 Request processed in 153us (10022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581602.735875:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788581602.736766:0:22606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43836680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184278912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581602.736789:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b3158e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31595 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581602.736799:0:22606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b3158e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31595 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581602.736876:0:22606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43836680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184279040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581602.736917:0:22606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581602.736960:0:22606:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581602.739305:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184279040 00000100:00100000:0.0:1788581602.739319:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184279040 00000100:00100000:0.0:1788581602.739380:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581602.739390:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+6:22606:x1875463184279040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581602.739544:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+6:22606:x1875463184279040:12345-0@lo:501:mount.lustre.0 Request processed in 156us (2625us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788581602.739564:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581602.739603:0:22606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43836680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184279040:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788581602.739643:0:22606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788581602.739660:0:22606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b3158e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31595 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581602.739670:0:22606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b3158e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31595 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581602.739680:0:22606:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff995e7f798800 10000000:01000000:2.0:1788581602.739698:0:22606:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788581602.739703:0:22606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff995e7f798800 10000000:01000000:2.0:1788581602.739705:0:22606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788581602.739708:0:22606:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff995e7f798800 from 1 10000000:01000000:2.0:1788581602.739711:0:22606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788581602.739750:0:22606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0f400/0x50f0cc74b7b3159c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581602.739757:0:22606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42b0f400/0x50f0cc74b7b3159c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581602.739765:0:22606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42b0f400/0x50f0cc74b7b3159c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581602.739782:0:22606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184279168:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788581602.746456:0:22606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581602.746583:0:22606:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e525ce9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581602.746743:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184279168 00000100:00100000:3.0:1788581602.746753:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184279168 00000100:00100000:3.0:1788581602.746834:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581602.746844:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+6:22606:x1875463184279168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581602.746859:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581602.746881:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6b000/0x50f0cc74b7b315a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b3159c expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581602.746905:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6b000/0x50f0cc74b7b315a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b3159c expref: 7 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581602.746915:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6b000/0x50f0cc74b7b315a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b3159c expref: 7 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581602.746923:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b000, rc 0) 00000100:00100000:3.0:1788581602.746971:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+7:22606:x1875463184279168:12345-0@lo:101:mount.lustre.0 Request processed in 128us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581602.746977:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788581602.747043:0:22606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184279168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581602.747059:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42b0f400/0x50f0cc74b7b3159c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b315a3 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581602.747068:0:22606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42b0f400/0x50f0cc74b7b3159c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b315a3 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581602.747085:0:22606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788581602.747103:0:22606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0f400/0x50f0cc74b7b3159c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b315a3 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581602.747111:0:22606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42b0f400/0x50f0cc74b7b3159c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b315a3 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581602.747118:0:22606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788581602.747133:0:22606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788581602.747138:0:22606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff995e7f798800 10000000:01000000:2.0:1788581602.747154:0:22606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788581602.747158:0:22606:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788581602.747160:0:22606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788581602.747184:0:22606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0fc00/0x50f0cc74b7b315aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581602.747192:0:22606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42b0fc00/0x50f0cc74b7b315aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581602.747200:0:22606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42b0fc00/0x50f0cc74b7b315aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581602.747219:0:22606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184279296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788581602.747251:0:22606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581602.755847:0:22606:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e525ce9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581602.756199:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184279296 00000100:00100000:0.0:1788581602.756208:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184279296 00000100:00100000:1.0:1788581602.763048:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581602.763066:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+7:22606:x1875463184279296:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581602.763085:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581602.763107:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42ccb000/0x50f0cc74b7b315b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b315aa expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581602.763150:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42ccb000/0x50f0cc74b7b315b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b315aa expref: 8 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581602.763161:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42ccb000/0x50f0cc74b7b315b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b315aa expref: 8 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581602.763171:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42ccb000, rc 0) 00000100:00100000:1.0:1788581602.763276:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+8:22606:x1875463184279296:12345-0@lo:101:mount.lustre.0 Request processed in 216us (16023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581602.763283:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788581602.763496:0:22606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184279296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581602.763517:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42b0fc00/0x50f0cc74b7b315aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b315b1 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581602.763526:0:22606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42b0fc00/0x50f0cc74b7b315aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b315b1 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581602.763601:0:22606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184279424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581602.763637:0:22606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581602.763662:0:22606:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e525ce9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581602.763715:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184279424 00000100:00100000:1.0:1788581602.763722:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184279424 00000100:00100000:1.0:1788581602.765653:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788581602.765665:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+8:22606:x1875463184279424:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581602.765974:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+9:22606:x1875463184279424:12345-0@lo:501:mount.lustre.0 Request processed in 311us (2336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581602.765981:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788581602.766143:0:22606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184279424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581602.766192:0:22606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184279552:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581602.766245:0:22606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581602.766302:0:22606:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e525ce9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581602.766661:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184279552 00000100:00100000:0.0:1788581602.766683:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184279552 00000100:00100000:0.0:1788581602.766750:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581602.766759:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+9:22606:x1875463184279552:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788581602.769860:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+9:22606:x1875463184279552:12345-0@lo:503:mount.lustre.0 Request processed in 3095us (3607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581602.769886:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788581602.770107:0:22606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184279552:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581602.775379:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a361c037-f8ee-420d-b76d-dbdb9328e15d:22644:1875463184279680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581602.775473:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581602.775524:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e525ce0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581602.775592:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184279680 00000100:00100000:1.0:1788581602.775599:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184279680 00000100:00100000:1.0:1788581602.775643:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581602.775652:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+9:22644:x1875463184279680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581602.777086:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+9:22644:x1875463184279680:12345-0@lo:502:llog_process_th.0 Request processed in 1430us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581602.777097:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788581602.777211:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a361c037-f8ee-420d-b76d-dbdb9328e15d:22644:1875463184279680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581602.777243:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581602.777276:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581602.777279:0:22644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788581602.777284:0:22644:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788581602.777288:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788581602.777303:0:22644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff995e6f8b19b8) 00000020:00000080:0.0:1788581602.777322:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788581602.777330:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788581602.777406:0:22644:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788581602.777413:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b315bf 00000020:00000080:0.0:1788581602.777630:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788581602.777635:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581602.777638:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581602.777640:0:22644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788581602.777643:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581602.777646:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581602.777648:0:22644:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788581602.777651:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788581602.777665:0:22644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff995e6f8b4d28) 00000020:00000080:0.0:1788581602.777675:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788581602.777679:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788581602.777682:0:22644:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788581602.777684:0:22644:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788581602.777690:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788581602.777734:0:22644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e7f798800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788581602.777745:0:22644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff995e6f8b0000) 00000020:00000080:0.0:1788581602.777752:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788581602.777810:0:22644:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788581602.777816:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b315d4 00000020:00000080:0.0:1788581602.777912:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788581602.777918:0:22644:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788581602.777923:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x50f0cc74b7b315db 00080000:01000000:0.0:1788581602.777928:0:22644:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788581602.777931:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b315e2 00010000:00010000:0.0:1788581602.891959:0:22644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788581602.892575:0:22644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:0.0:1788581602.893322:0:22644:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788581602.893792:0:22644:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff995e6f8b3370) 00000020:00000080:0.0:1788581602.893809:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788581602.893874:0:22644:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788581602.893881:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b315f0 00000020:00000080:0.0:1788581602.894632:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788581602.903005:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x50f0cc74b7b315f7 00000020:00000080:1.0:1788581602.903584:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788581602.903602:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581602.903608:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.903610:0:22644:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788581602.903613:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788581602.903616:0:22644:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788581602.903618:0:22644:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788581602.903619:0:22644:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788581602.903621:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788581602.903623:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.903625:0:22644:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788581602.903627:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581602.903631:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.903632:0:22644:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788581602.903636:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788581602.903676:0:22644:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788581602.903691:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581602.903694:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.903696:0:22644:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788581602.903698:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581602.903701:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.903703:0:22644:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788581602.903705:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788581602.903711:0:22644:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:00000080:1.0:1788581602.903737:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788581602.903751:0:22644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff995e478719b8) 00000020:00000080:1.0:1788581602.903764:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788581602.903769:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788581602.903819:0:22644:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788581602.903824:0:22644:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788581602.903830:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b31605 00010000:00080000:1.0:1788581602.903871:0:22644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e42f11800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1788581602.906080:0:22644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788581602.907395:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788581602.907408:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788581602.907443:0:22644:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788581602.907471:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b3160c 00000100:00080000:3.0:1788581602.907482:0:22644:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788581602.907487:0:22644:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff995e42f11800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581602.907522:0:22644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43836a00 x1875463184279808/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581602.907546:0:22644:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788581602.907646:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184279808:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788581602.907728:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788581602.907844:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581602.907848:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581602.907855:0:22644:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788581602.907858:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788581602.907860:0:22644:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788581602.907862:0:22644:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788581602.907864:0:22644:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788581602.907865:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788581602.907868:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581602.907869:0:22644:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788581602.907872:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788581602.907876:0:22644:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788581602.907879:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581602.907881:0:22644:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788581602.907883:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788581602.907887:0:22644:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:3.0:1788581602.907916:0:22644:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788581602.907918:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788581602.907930:0:22644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff995d41c04d28) 00000020:00000080:3.0:1788581602.907942:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788581602.907946:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788581602.908000:0:22644:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788581602.908005:0:22644:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788581602.908010:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b3161a 00010000:00080000:3.0:1788581602.908033:0:22644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e4eb3a800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1788581602.908220:0:22644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1788581602.908659:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184279808 00000100:00100000:0.0:1788581602.908668:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184279808 00000100:00100000:0.0:1788581602.908699:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788581602.908707:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875463184279808:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1788581602.908722:0:22631:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1788581602.916572:0:22644:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788581602.916999:0:22644:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788581602.919846:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184279936:0@lo:400:kworker.0 00000100:00100000:3.0:1788581602.919989:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581602.921869:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184279936 00000100:00100000:1.0:1788581602.921885:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184279936 00000100:00100000:1.0:1788581602.921950:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581602.921961:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+9:3620:x1875463184279936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581602.922051:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+9:3620:x1875463184279936:12345-0@lo:400:kworker.0 Request processed in 92us (2062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581602.922059:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581602.922127:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184279936:0@lo:400:kworker.0 00000040:00080000:3.0:1788581602.922144:0:22644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581602.928477:0:22644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:0.0:1788581602.932974:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875463184279808:12345-0@lo:38:llog_process_th.0 Request processed in 24257us (25235us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788581602.933000:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788581602.933017:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e42f11800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788581602.933025:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788581602.933030:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184279808:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788581602.933612:0:22644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1788581602.934123:0:22650:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788581602.934136:0:22650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788581602.935301:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788581602.935314:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788581602.935353:0:22644:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788581602.935374:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b31621 00000100:00080000:0.0:1788581602.935384:0:22644:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788581602.935389:0:22644:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff995e4eb3a800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581602.935423:0:22644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e45153b80 x1875463184280064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788581602.935444:0:22644:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788581602.935561:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581602.935566:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581602.935568:0:22644:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788581602.935570:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788581602.935573:0:22644:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788581602.935574:0:22644:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788581602.935576:0:22644:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788581602.935578:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788581602.935580:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581602.935582:0:22644:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788581602.935584:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788581602.935588:0:22644:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788581602.935591:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581602.935592:0:22644:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788581602.935595:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788581602.935598:0:22644:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:0.0:1788581602.935622:0:22644:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788581602.935625:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788581602.935645:0:22644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff995e4e3719b8) 00000020:00000080:0.0:1788581602.935658:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1788581602.935669:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788581602.935723:0:22644:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788581602.935728:0:22644:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788581602.935734:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50f0cc74b7b3162f 00010000:00080000:0.0:1788581602.935762:0:22644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e48649800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:0.0:1788581602.935967:0:22644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788581602.936034:0:22644:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788581602.936049:0:22644:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788581602.936554:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184280064:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788581602.936620:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184280064 offset 0 length 520: 4 00000040:00080000:0.0:1788581602.937978:0:22644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788581602.938285:0:22644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788581602.938502:0:22644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1788581602.939011:0:22652:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788581602.939016:0:22652:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788581602.942018:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788581602.942036:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788581602.942080:0:22644:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788581602.942101:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b31636 00000100:00080000:1.0:1788581602.942110:0:22644:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788581602.942116:0:22644:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff995e48649800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581602.942150:0:22644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e766e9c00 x1875463184280192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788581602.942218:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184280192:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788581602.942300:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184280192 offset 0 length 520: 4 00000100:00080000:1.0:1788581602.942376:0:22644:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788581602.942432:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581602.942442:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.942443:0:22644:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788581602.942447:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581602.942450:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.942451:0:22644:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788581602.942454:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788581602.942456:0:22644:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788581602.942458:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581602.942471:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.942472:0:22644:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788581602.942475:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581602.942477:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.942479:0:22644:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788581602.942482:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788581602.942508:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a361c037-f8ee-420d-b76d-dbdb9328e15d:22644:1875463184280320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581602.942556:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581602.942586:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184280320 00000100:00100000:1.0:1788581602.942592:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184280320 00000100:00100000:1.0:1788581602.942629:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788581602.942637:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+9:22644:x1875463184280320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581602.942736:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+9:22644:x1875463184280320:12345-0@lo:502:llog_process_th.0 Request processed in 98us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581602.942743:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788581602.942789:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f996300 going to sleep for 11 seconds 00000100:00100000:1.0:1788581602.942806:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a361c037-f8ee-420d-b76d-dbdb9328e15d:22644:1875463184280320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788581602.942830:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581602.942834:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.942836:0:22644:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788581602.942839:0:22644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788581602.944190:0:22606:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788581602.944224:0:22606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788581602.944248:0:22606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0fc00/0x50f0cc74b7b315aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b315b1 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581602.944286:0:22606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42b0fc00/0x50f0cc74b7b315aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b315b1 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581602.944295:0:22606:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e7f798800 from 1 10000000:01000000:0.0:1788581602.944299:0:22606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788581602.944337:0:22606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3163d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581602.944345:0:22606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3163d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581602.944355:0:22606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3163d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581602.944375:0:22606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184280448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788581602.944427:0:22606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581602.944488:0:22606:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a70e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581602.944557:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184280448 00000100:00100000:2.0:1788581602.944564:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184280448 00000100:00100000:2.0:1788581602.944604:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788581602.944612:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+9:22606:x1875463184280448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581602.944625:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581602.944638:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0ea00/0x50f0cc74b7b31644 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b3163d expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581602.944659:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0ea00/0x50f0cc74b7b31644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b3163d expref: 10 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581602.944669:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0ea00/0x50f0cc74b7b31644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b3163d expref: 10 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581602.944678:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0ea00, rc 0) 00000100:00100000:2.0:1788581602.944711:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+10:22606:x1875463184280448:12345-0@lo:101:mount.lustre.0 Request processed in 100us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581602.944717:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788581602.946044:0:22606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184280448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581602.946067:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3163d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31644 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581602.946078:0:22606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3163d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31644 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581602.946672:0:22606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184280576:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788581602.946745:0:22606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581602.946779:0:22606:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a70e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581602.946864:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184280576 00000100:00100000:2.0:1788581602.946871:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184280576 00000100:00100000:2.0:1788581602.946922:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788581602.946939:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+10:22606:x1875463184280576:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788581602.946958:0:22620:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788581602.946963:0:22620:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788581602.947042:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+10:22606:x1875463184280576:12345-0@lo:256:mount.lustre.0 Request processed in 105us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581602.947049:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788581602.947683:0:22606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184280576:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788581602.948319:0:22606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788581602.948337:0:22606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3163d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31644 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581602.948348:0:22606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3163d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31644 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581602.948356:0:22606:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e7f798800 from 1 10000000:01000000:0.0:1788581602.948359:0:22606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581602.948395:0:22606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b3164b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581602.948403:0:22606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b3164b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581602.948412:0:22606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b3164b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581602.948498:0:22606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184280704:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788581602.948547:0:22606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581602.948578:0:22606:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a70e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581602.948717:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184280704 00000100:00100000:2.0:1788581602.948725:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184280704 00000100:00100000:2.0:1788581602.948770:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788581602.948779:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+10:22606:x1875463184280704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581602.948791:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581602.948804:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b31652 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b3164b expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581602.948824:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b31652 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b3164b expref: 11 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581602.948833:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b31652 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b3164b expref: 11 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581602.948841:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f000, rc 0) 00000100:00100000:2.0:1788581602.948875:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+11:22606:x1875463184280704:12345-0@lo:101:mount.lustre.0 Request processed in 97us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581602.948881:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788581602.949645:0:22606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184280704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581602.949662:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b3164b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31652 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581602.949673:0:22606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b3164b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31652 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581602.949741:0:22606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184280832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581602.949777:0:22606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581602.949850:0:22606:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a70e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581602.952377:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184280832 00000100:00100000:2.0:1788581602.952392:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184280832 00000100:00100000:2.0:1788581602.952453:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788581602.952473:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+11:22606:x1875463184280832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581602.952760:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+11:22606:x1875463184280832:12345-0@lo:501:mount.lustre.0 Request processed in 297us (2981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581602.952768:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788581602.953090:0:22606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184280832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581602.953145:0:22606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184280960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581602.953193:0:22606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581602.953228:0:22606:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f996300 going to sleep for 11 seconds 00000100:00100000:0.0:1788581602.953287:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184280960 00000100:00100000:0.0:1788581602.953293:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184280960 00000100:00100000:0.0:1788581602.953326:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788581602.953343:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+11:22606:x1875463184280960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788581602.953429:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+11:22606:x1875463184280960:12345-0@lo:503:mount.lustre.0 Request processed in 95us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581602.953436:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788581602.953587:0:22606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184280960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581602.953976:0:22654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a361c037-f8ee-420d-b76d-dbdb9328e15d:22654:1875463184281088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581602.954010:0:22654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581602.954035:0:22654:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f996480 going to sleep for 11 seconds 00000100:00100000:0.0:1788581602.954075:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184281088 00000100:00100000:0.0:1788581602.954079:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184281088 00000100:00100000:0.0:1788581602.954108:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788581602.954114:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+11:22654:x1875463184281088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581602.954643:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+11:22654:x1875463184281088:12345-0@lo:502:llog_process_th.0 Request processed in 527us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581602.954656:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788581602.954725:0:22654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a361c037-f8ee-420d-b76d-dbdb9328e15d:22654:1875463184281088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788581602.954749:0:22654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581602.954757:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.954759:0:22654:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788581602.954765:0:22654:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e7f798800 00000020:00000080:1.0:1788581602.954768:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788581602.954776:0:22654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581602.954778:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.954779:0:22654:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788581602.954782:0:22654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581602.954784:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.954785:0:22654:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788581602.954788:0:22654:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e7f798800 00000020:00000080:1.0:1788581602.954790:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788581602.954840:0:22654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581602.954843:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.954844:0:22654:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788581602.954846:0:22654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581602.954849:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.954850:0:22654:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788581602.954853:0:22654:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e7f798800 00000020:00000080:1.0:1788581602.954856:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788581602.954876:0:22654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581602.954879:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.954880:0:22654:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788581602.954882:0:22654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581602.954885:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.954886:0:22654:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788581602.955998:0:22654:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e7f798800 00000020:00000080:1.0:1788581602.956007:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788581602.956076:0:22654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a361c037-f8ee-420d-b76d-dbdb9328e15d:22654:1875463184281216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581602.956129:0:22654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581602.956165:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184281216 00000100:00100000:1.0:1788581602.956171:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184281216 00000100:00100000:1.0:1788581602.956204:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788581602.956211:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+11:22654:x1875463184281216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581602.956319:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+11:22654:x1875463184281216:12345-0@lo:502:llog_process_th.0 Request processed in 107us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581602.956326:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788581602.959473:0:22654:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d422143c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581602.959510:0:22654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a361c037-f8ee-420d-b76d-dbdb9328e15d:22654:1875463184281216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788581602.959550:0:22654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581602.959558:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581602.959561:0:22654:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788581602.959565:0:22654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788581602.959761:0:22606:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788581602.959790:0:22606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788581602.959817:0:22606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b3164b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31652 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581602.959829:0:22606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b3164b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31652 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581602.959883:0:22606:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788581602.959886:0:22606:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff995e7f798800 10000000:01000000:0.0:1788581602.959890:0:22606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff995e7f798800 10000000:01000000:0.0:1788581602.959894:0:22606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788581602.959900:0:22606:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e7f798800 from 1 10000000:01000000:0.0:1788581602.959903:0:22606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788581602.959939:0:22606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b31659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581602.959947:0:22606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b31659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581602.959958:0:22606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b31659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581602.959979:0:22606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184281344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788581602.960041:0:22606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581602.960070:0:22606:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581602.960090:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184281344 00000100:00100000:0.0:1788581602.960097:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184281344 00000100:00100000:0.0:1788581602.961097:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788581602.961112:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+11:22606:x1875463184281344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581602.961127:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581602.961749:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995d43272000/0x50f0cc74b7b31660 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b31659 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581602.961800:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43272000/0x50f0cc74b7b31660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b31659 expref: 12 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581602.961813:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995d43272000/0x50f0cc74b7b31660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31659 expref: 12 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581602.961822:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43272000, rc 0) 00000100:00100000:0.0:1788581602.961906:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:22606:x1875463184281344:12345-0@lo:101:mount.lustre.0 Request processed in 799us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581602.961913:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788581602.963520:0:22606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184281344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581602.963544:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b31659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31660 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581602.963556:0:22606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b31659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31660 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581602.963642:0:22606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184281472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581602.963698:0:22606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581602.963733:0:22606:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d422143c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581602.963755:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184281472 00000100:00100000:1.0:1788581602.963761:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184281472 00000100:00100000:1.0:1788581602.963801:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788581602.963810:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:22606:x1875463184281472:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581602.963945:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:22606:x1875463184281472:12345-0@lo:501:mount.lustre.0 Request processed in 134us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581602.963953:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788581602.963993:0:22606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184281472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581602.964020:0:22606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184281600:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581602.964057:0:22606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581602.964079:0:22606:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d422143c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581602.964082:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184281600 00000100:00100000:0.0:1788581602.964086:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184281600 00000100:00100000:0.0:1788581602.964127:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581602.964148:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:22606:x1875463184281600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788581602.964840:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:22606:x1875463184281600:12345-0@lo:503:mount.lustre.0 Request processed in 703us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581602.964847:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788581602.969999:0:22606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184281600:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581602.976137:0:22659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a361c037-f8ee-420d-b76d-dbdb9328e15d:22659:1875463184281728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581602.976224:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581602.976294:0:22659:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e512b1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788581602.976377:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184281728 00000100:00100000:0.0:1788581602.976385:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184281728 00000100:00100000:0.0:1788581602.976430:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788581602.976440:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:22659:x1875463184281728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581602.976583:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:22659:x1875463184281728:12345-0@lo:502:llog_process_th.0 Request processed in 145us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581602.976599:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788581602.976739:0:22659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a361c037-f8ee-420d-b76d-dbdb9328e15d:22659:1875463184281728:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788581602.976797:0:22659:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788581602.976812:0:22659:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff995e7a690000) 00000020:00000080:2.0:1788581602.976831:0:22659:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788581602.976983:0:22659:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e7f798800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788581602.976987:0:22659:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e7f798800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788581602.976990:0:22659:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e7f798800 4 00010000:00080000:2.0:1788581602.977026:0:22659:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e524de800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1788581602.981083:0:22659:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788581602.981616:0:22659:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788581602.981672:0:22659:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788581602.981688:0:22659:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x50f0cc74b7b3166e 00000100:00080000:0.0:1788581602.981700:0:22659:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788581602.981707:0:22659:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff995e524de800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581602.981745:0:22659:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e45153800 x1875463184281856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788581602.981801:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875463184281856:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788581602.981871:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788581602.982038:0:22659:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788581602.982304:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184281856 00000100:00100000:1.0:1788581602.982314:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184281856 00000100:00100000:1.0:1788581602.983454:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581602.983474:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875463184281856:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788581602.983553:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875463184281856:12345-0@lo:38:llog_process_th.0 Request processed in 78us (1679us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788581602.983560:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581602.983693:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788581602.983701:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e524de800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788581602.983711:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788581602.983715:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875463184281856:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788581602.987489:0:22659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45150700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a361c037-f8ee-420d-b76d-dbdb9328e15d:22659:1875463184281984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581602.987568:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581602.987602:0:22659:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788581602.987759:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184281984 00000100:00100000:1.0:1788581602.987766:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184281984 00000100:00100000:1.0:1788581602.987809:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788581602.987818:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:22659:x1875463184281984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581602.988005:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:22659:x1875463184281984:12345-0@lo:502:llog_process_th.0 Request processed in 188us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581602.988013:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788581602.990052:0:22659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45150700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a361c037-f8ee-420d-b76d-dbdb9328e15d:22659:1875463184281984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581602.990120:0:22659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45150700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a361c037-f8ee-420d-b76d-dbdb9328e15d:22659:1875463184282112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581602.990180:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581602.990219:0:22659:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788581602.992427:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184282112 00000100:00100000:1.0:1788581602.992439:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184282112 00000100:00100000:1.0:1788581602.992499:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788581602.992511:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:22659:x1875463184282112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581602.992661:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:22659:x1875463184282112:12345-0@lo:502:llog_process_th.0 Request processed in 152us (2480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581602.992669:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788581602.992726:0:22659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45150700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a361c037-f8ee-420d-b76d-dbdb9328e15d:22659:1875463184282112:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788581602.992757:0:22659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788581603.002830:0:22606:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788581603.002863:0:22606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788581603.002879:0:22606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b31659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31660 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581603.002904:0:22606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995d43272e00/0x50f0cc74b7b31659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31660 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788581603.002970:0:22606:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788581603.002973:0:22606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788581603.002974:0:22606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581603.002976:0:22606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581603.002977:0:22606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581603.002978:0:22606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581603.002980:0:22606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788581603.002981:0:22606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788581603.002983:0:22606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581603.002984:0:22606:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788581603.002988:0:22606:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788581603.002990:0:22606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788581603.002991:0:22606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788581603.002992:0:22606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581603.002993:0:22606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581603.002994:0:22606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581603.002995:0:22606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581603.002997:0:22606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788581603.002997:0:22606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788581603.002998:0:22606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581603.002999:0:22606:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788581603.003025:0:22606:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788581603.003045:0:22606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184282240:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788581603.003110:0:22606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581603.003145:0:22606:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788581603.005000:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184282240 00000100:00100000:1.0:1788581603.005012:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184282240 00000100:00100000:1.0:1788581603.005067:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788581603.005078:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:22606:x1875463184282240:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788581603.005108:0:22622:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788581603.005121:0:22622:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788581603.012548:0:22622:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788581603.012566:0:22622:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788581603.012880:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:22606:x1875463184282240:12345-0@lo:253:mount.lustre.0 Request processed in 7800us (9765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581603.012902:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 20000000:01000000:0.0:1788581603.013010:0:22642:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788581603.013015:0:22642:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788581603.013035:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995d43273000/0x50f0cc74b7b31675 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581603.013050:0:22642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42b0ea00/0x50f0cc74b7b31644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b3163d expref: 11 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581603.013058:0:22642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995d43273000/0x50f0cc74b7b31675 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581603.013100:0:22642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42b0ea00/0x50f0cc74b7b31644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b3163d expref: 11 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581603.013112:0:22642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e42b0ea00/0x50f0cc74b7b31644 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b3163d expref: 11 pid: 22621 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581603.013127:0:22642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875463184282368:0@lo:104: 00000100:00100000:0.0:1788581603.013163:0:22642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581603.013203:0:22642:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788581603.013237:0:22606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:22606:1875463184282240:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788581603.013249:0:22606:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788581603.013277:0:22606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788581603.013279:0:22606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788581603.013280:0:22606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581603.013281:0:22606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581603.013282:0:22606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581603.013284:0:22606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581603.013285:0:22606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788581603.013287:0:22606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788581603.013288:0:22606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581603.013290:0:22606:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788581603.013305:0:22606:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788581603.014007:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184282368 00000100:00100000:3.0:1788581603.014015:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184282368 00000100:00100000:3.0:1788581603.014059:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581603.014069:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+3:22642:x1875463184282368:12345-0@lo:104: 00010000:00010000:3.0:1788581603.014082:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3163d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b31644 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581603.014136:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788581603.014142:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+3:22642:x1875463184282368:12345-0@lo:104: Request processed in 76us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581603.014149:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788581603.014250:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581603.014446:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3163d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b31644 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581603.014470:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43273400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581603.014475:0:22616:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3163d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b31644 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581603.014482:0:22616:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3163d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b31644 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581603.014490:0:22616:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3163d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b31644 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581603.014495:0:22616:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581603.014531:0:22616:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3163d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31644 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581603.014538:0:22616:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581603.014558:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3163d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31644 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581603.014565:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3163d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31644 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581603.014581:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581603.014582:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581603.014584:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581603.030477:0:22642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875463184282368:0@lo:104: 00010000:00010000:0.0:1788581603.030502:0:22642:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995d43273000/0x50f0cc74b7b31675 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581603.038795:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581603.038822:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184282496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581603.039006:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581603.039104:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184282496 00000100:00100000:3.0:1788581603.039113:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184282496 00010000:00010000:3.0:1788581603.039145:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42b0ea00/0x50f0cc74b7b31644 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b3163d expref: 12 pid: 22621 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581603.039179:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581603.039189:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:3620:x1875463184282496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581603.039204:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581603.039210:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42b0ea00/0x50f0cc74b7b31644 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b3163d expref: 12 pid: 22621 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581603.039233:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42b0ea00/0x50f0cc74b7b31644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b3163d expref: 12 pid: 22621 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581603.039282:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0ea00/0x50f0cc74b7b31644 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b3163d expref: 12 pid: 22621 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581603.039298:0:22612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995d43273000/0x50f0cc74b7b31675 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581603.039306:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43273000/0x50f0cc74b7b31675 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788581603.039322:0:22612:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.026306895s 00010000:00010000:3.0:1788581603.039325:0:22612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995d43273000/0x50f0cc74b7b31675 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581603.039332:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995d43273000/0x50f0cc74b7b31675 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581603.039338:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995d43273000/0x50f0cc74b7b31675 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581603.039345:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995d43273000/0x50f0cc74b7b31675 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581603.039351:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43273000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581603.039356:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995d43273000/0x50f0cc74b7b31675 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581603.039364:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995d43273000/0x50f0cc74b7b31675 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581603.039387:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995d43273000/0x50f0cc74b7b31675 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581603.039397:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581603.039442:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+11:3620:x1875463184282496:12345-0@lo:103:ldlm_bl.0 Request processed in 254us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581603.039449:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581603.039499:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184282496:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581603.039598:0:22642:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995d43273000/0x50f0cc74b7b31675 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581603.039607:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995d43273000/0x50f0cc74b7b31675 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581603.039620:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995d43273000/0x50f0cc74b7b31675 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788581603.046858:0:22606:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1788581603.047249:0:22606:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788581603.047602:0:22667:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788581603.047712:0:22606:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1788581603.048050:0:22668:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff995d43836d80 x1875463184282624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581603.048062:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00000040:01000000:2.0:1788581603.048446:0:22606:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788581603.048505:0:22606:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788581603.048945:0:22606:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788581603.048953:0:22606:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788581603.048989:0:22606:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788581603.049998:0:22606:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788581603.050549:0:22606:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788581603.050592:0:22606:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000020:00080000:0.0:1788581603.051168:0:22666:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:0.0:1788581603.051174:0:22666:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:00080000:0.0:1788581603.051866:0:22667:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581603.054349:0:22606:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1788581603.054875:0:22606:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000040:00080000:0.0:1788581603.056653:0:22667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788581603.056733:0:22667:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000001:00000004:3.0:1788581603.057370:0:22606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1788581603.059025:0:22606:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788581603.059060:0:22606:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffabf140d87988 00100000:10000000:3.0:1788581603.059068:0:22606:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788581603.059853:0:22606:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788581603.059869:0:22606:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788581603.059887:0:22606:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1788581603.059913:0:22606:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788581603.067981:0:22606:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788581603.068198:0:22606:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788581603.589011:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788581603.650056:0:22624:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788581603.650064:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e7f798800 from 11 10000000:01000000:3.0:1788581603.650069:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788581603.650112:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3167c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581603.650135:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3167c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581603.650148:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3167c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581603.650174:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43836300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184282752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581603.650241:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581603.651075:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f268b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581603.652438:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184282752 00000100:00100000:2.0:1788581603.652448:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184282752 00000100:00100000:2.0:1788581603.652546:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788581603.652556:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+11:22624:x1875463184282752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581603.652570:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581603.652587:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b31683 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b3167c expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581603.652610:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b31683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b3167c expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581603.652621:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b31683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b3167c expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581603.652631:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f600, rc 0) 00000100:00100000:2.0:1788581603.652696:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:22624:x1875463184282752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (2455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581603.652703:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788581603.652768:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43836300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184282752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581603.652785:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3167c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31683 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581603.652794:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3167c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31683 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581603.652858:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43836300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184282880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788581603.652906:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581603.655596:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f268b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581603.655607:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184282880 00000100:00100000:1.0:1788581603.655618:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184282880 00000100:00100000:1.0:1788581603.655680:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788581603.655691:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:22624:x1875463184282880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788581603.656300:0:22620:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788581603.656316:0:22620:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788581603.656320:0:22620:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788581603.656476:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:22624:x1875463184282880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 786us (3566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581603.656485:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788581603.656498:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43836300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184282880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788581603.656553:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788581603.656563:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3167c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31683 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581603.656574:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3167c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31683 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581604.035797:0:22661:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788581604.035806:0:22661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788581604.037211:0:22661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788581604.037222:0:22661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788581604.099385:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00010000:00010000:1.0:1788581604.609630:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581605.057570:0:22661:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788581605.057584:0:22661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788581605.057757:0:22661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1788581605.057887:0:22661:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788581605.058089:0:22661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1788581605.126326:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00010000:00010000:1.0:1788581605.640705:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581606.148900:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00010000:00010000:1.0:1788581606.668233:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581607.169700:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00000001:02000400:2.0:1788581607.648697:0:22911:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788581607.681998:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581608.195023:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00000100:00080000:2.0:1788581608.258488:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788581608.258495:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788581608.258498:0:8:0:(import.c:65:import_set_state_nolock()) ffff995e42f11800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581608.258507:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 589 00000100:00080000:2.0:1788581608.258512:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788581608.258518:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff995e42f11800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581608.258540:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e550ac000 x1875463184283136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788581608.258557:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581608.258561:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788581608.258564:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581608.258567:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788581608.258569:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788581608.258572:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788581608.258574:0:8:0:(import.c:65:import_set_state_nolock()) ffff995e524de800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581608.258578:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff995e524de800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581608.258590:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e550aca80 x1875463184283264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581608.258615:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184283136:0@lo:38:kworker.0 00000100:00100000:2.0:1788581608.258726:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581608.258792:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875463184283264:0@lo:38:kworker.0 00000100:00100000:2.0:1788581608.258819:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581608.258873:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184283136 00000100:00100000:2.0:1788581608.258879:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184283136 00000100:00100000:2.0:1788581608.258909:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581608.258916:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875463184283136:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788581608.258932:0:22632:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788581608.258970:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875463184283136:12345-0@lo:38:kworker.0 Request processed in 53us (243us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788581608.258977:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788581608.259009:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e42f11800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788581608.259014:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788581608.259018:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184283136:0@lo:38:kworker.0 00000100:00100000:3.0:1788581608.259155:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a361c037-f8ee-420d-b76d-dbdb9328e15d:3618:1875463184283008:0@lo:400:kworker.0 00000100:00100000:3.0:1788581608.259207:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581608.259550:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184283264 00000100:00100000:1.0:1788581608.259555:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184283264 00000100:00100000:1.0:1788581608.259582:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581608.259588:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875463184283264:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788581608.259607:0:22628:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 594 last 0 00000020:00000080:1.0:1788581608.259643:0:22628:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x50f0cc74b7b3168a 00000004:00100000:1.0:1788581608.259658:0:22628:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788581608.259781:0:22628:0:(import.c:65:import_set_state_nolock()) ffff995d43b90000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581608.259826:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875463184283264:12345-0@lo:38:kworker.0 Request processed in 237us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581608.259833:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581608.260007:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184283008 00000100:00100000:2.0:1788581608.260011:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184283008 00000100:00100000:2.0:1788581608.260049:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788581608.260056:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:3618:x1875463184283008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581608.260094:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:3618:x1875463184283008:12345-0@lo:400:kworker.0 Request processed in 39us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581608.260101:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788581608.260142:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff995e550aca80 x1875463184283264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788581608.260156:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788581608.260164:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788581608.260168:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788581608.260170:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e524de800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788581608.260187:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875463184283264:0@lo:38:kworker.0 00000100:00100000:1.0:1788581608.261451:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a361c037-f8ee-420d-b76d-dbdb9328e15d:3618:1875463184283008:0@lo:400:kworker.0 00000020:00000004:3.0:1788581608.574654:0:22963:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788581608.574839:0:22963:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788581608.706818:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581609.221967:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00000020:00000004:2.0:1788581609.468731:0:23013:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788581609.469006:0:23013:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788581609.732429:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581610.241351:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00010000:00010000:1.0:1788581610.756623:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581611.265530:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00010000:00010000:1.0:1788581611.777520:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581612.291938:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00000100:00100000:2.0:1788581612.358913:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581602/real 1788581602] req@ffff995e766e9c00 x1875463184280192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581612 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581612.359719:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995e766e9c00 x1875463184280192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581612 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581612.359808:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581602/real 1788581602] req@ffff995e45153b80 x1875463184280064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581612 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581612.359828:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995e45153b80 x1875463184280064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581612 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788581612.359913:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e48649800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581612.361210:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788581612.361219:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184280192:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788581612.361229:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4eb3a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788581612.361436:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788581612.361441:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788581612.361444:0:8:0:(import.c:65:import_set_state_nolock()) ffff995e42f11800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788581612.361449:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 594 00000100:00080000:1.0:1788581612.361455:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788581612.361462:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff995e42f11800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581612.361485:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e766e8000 x1875463184283520/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788581612.361496:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581612.361499:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788581612.361500:0:8:0:(import.c:65:import_set_state_nolock()) ffff995e4eb3a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788581612.361503:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 589 00000100:00080000:1.0:1788581612.361505:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788581612.361508:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff995e4eb3a800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581612.361518:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e766ebb80 x1875463184283648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788581612.361525:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581612.361527:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788581612.361529:0:8:0:(import.c:65:import_set_state_nolock()) ffff995e48649800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788581612.361532:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 589 00000100:00080000:1.0:1788581612.361534:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788581612.361549:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff995e48649800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581612.361560:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e766eb100 x1875463184283776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788581612.361753:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a361c037-f8ee-420d-b76d-dbdb9328e15d:3619:1875463184283392:0@lo:400:kworker.0 00000100:00100000:0.0:1788581612.361822:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788581612.362246:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788581612.362266:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184280064:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788581612.362296:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184283520:0@lo:38:kworker.0 00000100:00100000:3.0:1788581612.362335:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581612.362387:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184283648:0@lo:8:kworker.0 00000400:00000100:3.0:1788581612.362419:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184283648 offset 0 length 520: 4 00000100:00100000:3.0:1788581612.362436:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184283776:0@lo:8:kworker.0 00000400:00000100:3.0:1788581612.362451:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184283776 offset 0 length 520: 4 00000100:00100000:2.0:1788581612.363158:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184283520 00000100:00100000:2.0:1788581612.363168:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184283520 00000100:00100000:2.0:1788581612.363209:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581612.363217:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875463184283520:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788581612.363235:0:22632:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788581612.363312:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875463184283520:12345-0@lo:38:kworker.0 Request processed in 94us (976us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788581612.363319:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788581612.363358:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e42f11800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788581612.363480:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788581612.363485:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184283520:0@lo:38:kworker.0 00000100:00100000:2.0:1788581612.365415:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788581612.365442:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184283904:0@lo:400:kworker.0 00000100:00100000:2.0:1788581612.365513:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581612.365794:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184283904 00000100:00100000:0.0:1788581612.365802:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184283904 00000100:00100000:0.0:1788581612.365857:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788581612.365865:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184283904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581612.365920:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184283904:12345-0@lo:400:kworker.0 Request processed in 56us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581612.365926:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788581612.365963:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff995e766e8380 x1875463184283904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581612.365994:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184283904:0@lo:400:kworker.0 00000100:00100000:1.0:1788581612.366198:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184283392 00000100:00100000:1.0:1788581612.366204:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184283392 00000100:00100000:1.0:1788581612.366232:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788581612.366238:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:3619:x1875463184283392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581612.366296:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:3619:x1875463184283392:12345-0@lo:400:kworker.0 Request processed in 58us (4474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581612.366301:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788581612.366339:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a361c037-f8ee-420d-b76d-dbdb9328e15d:3619:1875463184283392:0@lo:400:kworker.0 00010000:00010000:2.0:1788581612.802374:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581613.317356:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00010000:00010000:3.0:1788581613.827800:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581614.340185:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00010000:00010000:0.0:1788581614.853301:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788581615.298859:0:22661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788581615.365013:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00010000:00010000:3.0:1788581615.875640:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788581616.044020:0:23358:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788581616.044024:0:23358:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788581616.044025:0:23358:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788581616.044140:0:23358:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff995e6be35800 00000020:01000004:3.0:1788581616.044156:0:23358:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788581616.044166:0:23358:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788581616.044179:0:23358:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff995d41c00000) 00000020:00000080:3.0:1788581616.044194:0:23358:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788581616.084323:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788581616.086144:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788581616.088232:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788581616.088619:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788581616.088800:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788581616.089025:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788581616.089207:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1788581616.089422:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788581616.089605:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788581616.089781:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788581616.090081:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788581616.090305:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788581616.090503:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788581616.090698:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788581616.091609:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788581616.091879:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788581616.092098:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1788581616.092326:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788581616.092551:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1788581616.092767:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788581616.093292:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788581616.093503:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1788581616.093731:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788581616.093964:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788581616.094187:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788581616.094492:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1788581616.094719:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1788581616.094928:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788581616.095146:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1788581616.095366:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1788581616.095599:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788581616.096069:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788581616.096294:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788581616.096527:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1788581616.096735:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788581616.097049:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788581616.097348:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788581616.097582:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788581616.097796:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788581616.098068:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1788581616.098302:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1788581616.098484:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788581616.098663:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1788581616.098866:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788581616.099052:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788581616.099241:0:23358:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00080000:01000000:0.0:1788581616.100126:0:23358:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788581616.100428:0:23358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788581616.100439:0:23358:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788581616.100455:0:23358:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b31698 00000020:01000004:0.0:1788581616.100462:0:23358:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788581616.100481:0:23358:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788581616.100485:0:23358:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788581616.100490:0:23358:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788581616.100516:0:23358:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788581616.100520:0:23358:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788581616.104073:0:23358:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788581616.104113:0:23358:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.103@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788581616.104119:0:23358:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788581616.104120:0:23358:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788581616.104122:0:23358:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581616.104123:0:23358:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581616.104124:0:23358:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581616.104125:0:23358:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581616.104126:0:23358:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788581616.104128:0:23358:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581616.104129:0:23358:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788581616.104133:0:23358:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788581616.104134:0:23358:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788581616.104135:0:23358:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788581616.104136:0:23358:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581616.104137:0:23358:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581616.104138:0:23358:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581616.104139:0:23358:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581616.104141:0:23358:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788581616.104141:0:23358:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581616.104142:0:23358:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788581616.104168:0:23358:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788581616.104188:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184284032:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788581616.104290:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581616.104345:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f268780 going to sleep for 11 seconds 00000100:00100000:3.0:1788581616.104529:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184284032 00000100:00100000:3.0:1788581616.104538:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184284032 00000100:00100000:3.0:1788581616.104639:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788581616.104649:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:23358:x1875463184284032:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788581616.104692:0:22622:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788581616.104695:0:22622:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788581616.104703:0:22622:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788581616.104985:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:23358:x1875463184284032:12345-0@lo:253:mount.lustre.0 Request processed in 337us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581616.104994:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788581616.105065:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184284032:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788581616.105075:0:23358:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788581616.105084:0:23358:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788581616.105085:0:23358:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788581616.105086:0:23358:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581616.105087:0:23358:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581616.105088:0:23358:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581616.105089:0:23358:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581616.105090:0:23358:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788581616.105091:0:23358:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581616.105092:0:23358:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788581616.105109:0:23358:0:(tgt_mount.c:101:server_register_mount()) register mount ffff995e6be35800 from lustre-MDT0001 10000000:01000000:0.0:1788581616.105135:0:23358:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788581616.105139:0:23358:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788581616.105146:0:23358:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff995e47874d28 local copy 00010000:00010000:0.0:1788581616.105156:0:23358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b3158e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31595 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581616.105431:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184284160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581616.105517:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581616.105679:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f268840 going to sleep for 11 seconds 00000100:00100000:1.0:1788581616.105740:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184284160 00000100:00100000:1.0:1788581616.105746:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184284160 00000100:00100000:1.0:1788581616.105771:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788581616.105778:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:23358:x1875463184284160:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581616.105861:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:23358:x1875463184284160:12345-0@lo:501:mount.lustre.0 Request processed in 83us (343us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788581616.105868:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581616.105942:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184284160:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788581616.105958:0:23358:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788581616.105977:0:23358:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788581616.105984:0:23358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b3158e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31595 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.105992:0:23358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b3158e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31595 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581616.106019:0:23358:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff995e6be35800 10000000:01000000:0.0:1788581616.106024:0:23358:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788581616.106028:0:23358:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff995e47874d28 10000000:01000000:0.0:1788581616.106040:0:23358:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788581616.106043:0:23358:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff995e47874d28 from 1 10000000:01000000:0.0:1788581616.106046:0:23358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788581616.106071:0:23358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43272a00/0x50f0cc74b7b3169f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.106078:0:23358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995d43272a00/0x50f0cc74b7b3169f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.106086:0:23358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995d43272a00/0x50f0cc74b7b3169f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581616.106098:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184284288:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788581616.106121:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581616.106143:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f268840 going to sleep for 11 seconds 00000100:00100000:1.0:1788581616.106246:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184284288 00000100:00100000:1.0:1788581616.106251:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184284288 00000100:00100000:1.0:1788581616.106294:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788581616.106300:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+12:23358:x1875463184284288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581616.106308:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581616.106320:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42cca800/0x50f0cc74b7b316a6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b3169f expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.106351:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42cca800/0x50f0cc74b7b316a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b3169f expref: 13 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.106362:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42cca800/0x50f0cc74b7b316a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b3169f expref: 13 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.106371:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42cca800, rc 0) 00000100:00100000:1.0:1788581616.106410:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+13:23358:x1875463184284288:12345-0@lo:101:mount.lustre.0 Request processed in 110us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581616.106417:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788581616.106513:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184284288:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581616.106525:0:23358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995d43272a00/0x50f0cc74b7b3169f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b316a6 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.106534:0:23358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995d43272a00/0x50f0cc74b7b3169f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b316a6 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581616.106550:0:23358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788581616.106561:0:23358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43272a00/0x50f0cc74b7b3169f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b316a6 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.106566:0:23358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995d43272a00/0x50f0cc74b7b3169f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b316a6 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581616.106573:0:23358:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff995e6be35800 10000000:01000000:0.0:1788581616.106585:0:23358:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788581616.106588:0:23358:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff995e6be35800 from 1 10000000:01000000:0.0:1788581616.106589:0:23358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788581616.106603:0:23358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43273c00/0x50f0cc74b7b316ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.106610:0:23358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995d43273c00/0x50f0cc74b7b316ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.106616:0:23358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995d43273c00/0x50f0cc74b7b316ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581616.106629:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184284416:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788581616.106654:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581616.106673:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f268840 going to sleep for 11 seconds 00000100:00100000:1.0:1788581616.106725:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184284416 00000100:00100000:1.0:1788581616.106730:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184284416 00000100:00100000:1.0:1788581616.106748:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788581616.106753:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+13:23358:x1875463184284416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581616.106760:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581616.106768:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42cca400/0x50f0cc74b7b316b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b316ad expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.106781:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42cca400/0x50f0cc74b7b316b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b316ad expref: 14 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.106789:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42cca400/0x50f0cc74b7b316b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b316ad expref: 14 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.106795:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42cca400, rc 0) 00000100:00100000:1.0:1788581616.106839:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+14:23358:x1875463184284416:12345-0@lo:101:mount.lustre.0 Request processed in 84us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581616.106845:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788581616.106968:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184284416:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581616.106977:0:23358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995d43273c00/0x50f0cc74b7b316ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b316b4 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.106984:0:23358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995d43273c00/0x50f0cc74b7b316ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b316b4 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581616.106993:0:23358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788581616.107007:0:23358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43273c00/0x50f0cc74b7b316ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b316b4 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.107013:0:23358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995d43273c00/0x50f0cc74b7b316ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b316b4 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581616.107019:0:23358:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788581616.107028:0:23358:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788581616.107032:0:23358:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff995e6be35800 10000000:01000000:0.0:1788581616.107036:0:23358:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788581616.107039:0:23358:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788581616.107041:0:23358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788581616.107055:0:23358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43273a00/0x50f0cc74b7b316bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.107062:0:23358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995d43273a00/0x50f0cc74b7b316bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.107069:0:23358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995d43273a00/0x50f0cc74b7b316bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581616.107080:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184284544:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788581616.107105:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581616.107116:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f268840 going to sleep for 11 seconds 00000100:00100000:1.0:1788581616.107163:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184284544 00000100:00100000:1.0:1788581616.107167:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184284544 00000100:00100000:1.0:1788581616.107183:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788581616.107188:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+14:23358:x1875463184284544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581616.107195:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581616.107202:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42ccb600/0x50f0cc74b7b316c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b316bb expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.107214:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42ccb600/0x50f0cc74b7b316c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b316bb expref: 15 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.107221:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42ccb600/0x50f0cc74b7b316c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b316bb expref: 15 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.107227:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42ccb600, rc 0) 00000100:00100000:1.0:1788581616.107388:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+15:23358:x1875463184284544:12345-0@lo:101:mount.lustre.0 Request processed in 198us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581616.107395:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788581616.107488:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184284544:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581616.107498:0:23358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995d43273a00/0x50f0cc74b7b316bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b316c2 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.107506:0:23358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995d43273a00/0x50f0cc74b7b316bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b316c2 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581616.108851:0:23358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1788581616.109547:0:23358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581616.113123:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788581616.113183:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1788581616.113201:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1788581616.113212:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1788581616.113222:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1788581616.113234:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1788581616.113248:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1788581616.113344:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1788581616.113359:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1788581616.113373:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1788581616.117827:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1788581616.117865:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1788581616.117882:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1788581616.117896:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1788581616.117909:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1788581616.117921:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1788581616.117935:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1788581616.117947:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1788581616.117962:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1788581616.117975:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1788581616.117987:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1788581616.117999:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1788581616.118013:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1788581616.118028:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1788581616.118041:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1788581616.118053:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1788581616.118066:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1788581616.118079:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1788581616.118092:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1788581616.118105:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1788581616.118116:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1788581616.118128:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1788581616.118141:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1788581616.118154:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1788581616.118165:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1788581616.118177:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1788581616.118189:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1788581616.118201:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1788581616.118215:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1788581616.118229:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1788581616.118243:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1788581616.118283:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1788581616.118301:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1788581616.118315:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1788581616.118360:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1788581616.118366:0:23358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1788581616.118487:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184284672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581616.122559:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581616.122623:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d5d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581616.122899:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184284672 00000100:00100000:3.0:1788581616.122908:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184284672 00000100:00100000:3.0:1788581616.122966:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788581616.122976:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+15:23358:x1875463184284672:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581616.123178:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+15:23358:x1875463184284672:12345-0@lo:501:mount.lustre.0 Request processed in 203us (1925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581616.123187:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788581616.123310:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184284672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581616.123362:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184284800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581616.123431:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581616.123463:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46a22300 going to sleep for 11 seconds 00000100:00100000:3.0:1788581616.124128:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184284800 00000100:00100000:3.0:1788581616.124136:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184284800 00000100:00100000:3.0:1788581616.124180:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788581616.124188:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+15:23358:x1875463184284800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788581616.125702:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+15:23358:x1875463184284800:12345-0@lo:503:mount.lustre.0 Request processed in 1510us (2265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581616.125725:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788581616.134445:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184284800:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788581616.134941:0:23358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788581616.135025:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184284928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581616.135103:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581616.135155:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46a22300 going to sleep for 11 seconds 00000100:00100000:3.0:1788581616.135394:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184284928 00000100:00100000:3.0:1788581616.135401:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184284928 00000100:00100000:3.0:1788581616.135448:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788581616.135457:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+15:23358:x1875463184284928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581616.136578:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+15:23358:x1875463184284928:12345-0@lo:502:mount.lustre.0 Request processed in 1115us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581616.136590:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788581616.136720:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184284928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788581616.136966:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788581616.136996:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1788581616.137011:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1788581616.137025:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1788581616.137039:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1788581616.137069:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1788581616.137084:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1788581616.137096:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1788581616.137109:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1788581616.137122:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1788581616.137137:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1788581616.137150:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1788581616.137167:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1788581616.137179:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1788581616.137190:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1788581616.137201:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1788581616.137212:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1788581616.137225:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1788581616.137236:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1788581616.137249:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1788581616.147722:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1788581616.147749:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1788581616.147760:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1788581616.147773:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1788581616.147786:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1788581616.147800:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1788581616.147814:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1788581616.147827:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1788581616.147840:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1788581616.147853:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1788581616.147866:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1788581616.147880:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1788581616.147893:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1788581616.147907:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1788581616.147919:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1788581616.147930:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1788581616.147941:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1788581616.147952:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1788581616.147964:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1788581616.147974:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1788581616.147985:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1788581616.148012:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1788581616.148023:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1788581616.148033:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1788581616.148078:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43836300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184285056:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581616.148151:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581616.148272:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e52c49300 going to sleep for 11 seconds 00000100:00100000:2.0:1788581616.152741:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184285056 00000100:00100000:2.0:1788581616.152771:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184285056 00000100:00100000:3.0:1788581616.154895:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788581616.154909:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+15:23358:x1875463184285056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581616.156019:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+15:23358:x1875463184285056:12345-0@lo:502:mount.lustre.0 Request processed in 1108us (7862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581616.156032:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788581616.159447:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43836300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184285056:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581616.159574:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:0.0:1788581616.159589:0:23358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788581616.170491:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581616.170506:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581616.170509:0:23362:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788581616.170517:0:23362:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788581616.170521:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788581616.170538:0:23362:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff995d41c019b8) 00000020:00000080:3.0:1788581616.170560:0:23362:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788581616.170567:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788581616.170673:0:23362:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788581616.170681:0:23362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b316d0 00000020:00000080:3.0:1788581616.170903:0:23362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788581616.170908:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581616.170912:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581616.170913:0:23362:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788581616.170916:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581616.170920:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581616.170921:0:23362:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788581616.170924:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788581616.170932:0:23362:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff995e7fa03370) 00000020:00000080:3.0:1788581616.170950:0:23362:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788581616.170955:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788581616.170957:0:23362:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788581616.170960:0:23362:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788581616.170966:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788581616.171012:0:23362:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e6be35800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788581616.171024:0:23362:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff995e7fa00000) 00000020:00000080:3.0:1788581616.171033:0:23362:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788581616.171105:0:23362:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788581616.171111:0:23362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b316e5 00000020:00000080:3.0:1788581616.171197:0:23362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788581616.171204:0:23362:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788581616.171214:0:23362:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x50f0cc74b7b316ec 00080000:01000000:3.0:1788581616.171220:0:23362:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788581616.171222:0:23362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b316f3 00010000:00010000:1.0:1788581616.319333:0:23362:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788581616.321531:0:23362:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1788581616.324996:0:23362:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788581616.328083:0:23362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788581616.328098:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581616.328105:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.328107:0:23362:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788581616.328111:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581616.328117:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.328118:0:23362:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788581616.328121:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788581616.328126:0:23362:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:00000080:2.0:1788581616.328154:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788581616.328170:0:23362:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff995e7a6919b8) 00000020:00000080:2.0:1788581616.328194:0:23362:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788581616.328200:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788581616.328299:0:23362:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788581616.328306:0:23362:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788581616.328312:0:23362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b31701 00010000:00080000:2.0:1788581616.328342:0:23362:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e6fad8000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1788581616.338004:0:23362:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788581616.341337:0:23362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788581616.341354:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788581616.341408:0:23362:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788581616.341430:0:23362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b31708 00000100:00080000:3.0:1788581616.341440:0:23362:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788581616.341445:0:23362:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff995e6fad8000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581616.341478:0:23362:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43836a00 x1875463184285184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581616.341496:0:23362:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788581616.341540:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788581616.341544:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788581616.341546:0:36:0:(import.c:65:import_set_state_nolock()) ffff995e42f11800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581616.341550:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 598 00000100:00080000:3.0:1788581616.341554:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788581616.341558:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff995e42f11800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581616.341674:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184285184:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788581616.341757:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581616.341832:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184285184 00000100:00100000:2.0:1788581616.341838:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184285184 00000100:00100000:2.0:1788581616.341870:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581616.341877:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875463184285184:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788581616.341903:0:22632:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 602 last 0 00000020:00000080:2.0:1788581616.341935:0:22632:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b3170f 00000004:00100000:2.0:1788581616.341950:0:22632:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788581616.341963:0:22632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000020:01000000:2.0:1788581616.342096:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581616.342102:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.342103:0:23362:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788581616.342107:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788581616.342110:0:23362:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788581616.342111:0:23362:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788581616.342113:0:23362:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788581616.342114:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788581616.342116:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.342117:0:23362:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788581616.342119:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581616.342123:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.342124:0:23362:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788581616.342128:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788581616.342182:0:23362:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788581616.342208:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581616.342212:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.342213:0:23362:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788581616.342216:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788581616.342218:0:23362:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788581616.342219:0:23362:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788581616.342221:0:23362:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788581616.342222:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788581616.342225:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.342226:0:23362:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788581616.342227:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788581616.342230:0:23362:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788581616.342233:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.342234:0:23362:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788581616.342237:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788581616.342241:0:23362:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:2.0:1788581616.342286:0:23362:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788581616.342294:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788581616.342309:0:23362:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff995e7a693370) 00000020:00000080:2.0:1788581616.342321:0:23362:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788581616.342326:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788581616.342390:0:23362:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788581616.342396:0:23362:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788581616.342401:0:23362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b3171d 00010000:00080000:2.0:1788581616.342425:0:23362:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e72849000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1788581616.342634:0:23362:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1788581616.343691:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43836680 x1875463184285312/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581616.343711:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581616.343715:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788581616.343718:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581616.343721:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788581616.343778:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184285440:0@lo:400:kworker.0 00000100:00100000:3.0:1788581616.343979:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581616.344031:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184285440 00000100:00100000:3.0:1788581616.344038:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184285440 00000100:00100000:3.0:1788581616.344079:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581616.344087:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184285440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581616.344133:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184285440:12345-0@lo:400:kworker.0 Request processed in 47us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581616.344140:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788581616.344175:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff995d43834e00 x1875463184285440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581616.344188:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184285440:0@lo:400:kworker.0 00000100:00100000:2.0:1788581616.345733:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184285312:0@lo:38:kworker.0 00000100:00100000:2.0:1788581616.346707:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1788581616.347411:0:23362:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788581616.347957:0:23362:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1788581616.349329:0:22631:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788581616.349342:0:22631:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788581616.352339:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184285312 00000100:00100000:0.0:1788581616.352352:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184285312 00000040:00080000:1.0:1788581616.353095:0:23362:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788581616.353996:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581616.354006:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3617:x1875463184285312:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788581616.354101:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3617:x1875463184285312:12345-0@lo:38:kworker.0 Request processed in 95us (7395us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788581616.354117:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581616.354178:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788581616.354185:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e42f11800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581616.354189:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788581616.354192:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184285312:0@lo:38:kworker.0 00000100:00080000:2.0:1788581616.354292:0:22632:0:(import.c:65:import_set_state_nolock()) ffff995e7284c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581616.354345:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1875463184285184:12345-0@lo:38:llog_process_th.0 Request processed in 12467us (12588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581616.354353:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:1.0:1788581616.354971:0:23362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788581616.355134:0:23362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1788581616.355249:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788581616.355283:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788581616.355291:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788581616.355297:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788581616.355300:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e6fad8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788581616.355320:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184285184:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788581616.355666:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184285568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581616.355720:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788581616.356371:0:23368:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788581616.356387:0:23368:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1788581616.356437:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184285568 00000100:00100000:1.0:1788581616.356444:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184285568 00000100:00100000:1.0:1788581616.356479:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581616.356488:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1875463184285568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788581616.356518:0:22631:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000020:00000080:0.0:1788581616.358173:0:23362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788581616.358188:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788581616.358233:0:23362:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788581616.358282:0:23362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b31724 00000100:00080000:0.0:1788581616.358292:0:23362:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788581616.358298:0:23362:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff995e72849000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581616.358330:0:23362:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e45151180 x1875463184285696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788581616.358350:0:23362:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788581616.358415:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581616.358419:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581616.358421:0:23362:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788581616.358423:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788581616.358426:0:23362:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788581616.358428:0:23362:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788581616.358430:0:23362:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788581616.358431:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788581616.358433:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581616.358435:0:23362:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788581616.358437:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788581616.358441:0:23362:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788581616.358445:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581616.358446:0:23362:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788581616.358449:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788581616.358452:0:23362:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:0.0:1788581616.358474:0:23362:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788581616.358477:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788581616.358489:0:23362:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff995e4e373370) 00000020:00000080:0.0:1788581616.358501:0:23362:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1788581616.358519:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788581616.358589:0:23362:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788581616.358596:0:23362:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788581616.358602:0:23362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50f0cc74b7b31732 00010000:00080000:0.0:1788581616.358629:0:23362:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995e6f8e2800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:0.0:1788581616.358868:0:23362:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788581616.358942:0:23362:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788581616.358960:0:23362:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788581616.359168:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1875463184285568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2677us (3443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581616.359177:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788581616.359697:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581616.359702:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788581616.359705:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581616.359707:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788581616.359733:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184285696:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788581616.359779:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184285696 offset 0 length 520: 4 00000040:00080000:0.0:1788581616.363489:0:23362:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788581616.364442:0:23362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000100:00100000:2.0:1788581616.364849:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184285568:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788581616.364976:0:23362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1788581616.365502:0:23370:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788581616.365506:0:23370:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788581616.367386:0:23362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788581616.367398:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788581616.367440:0:23362:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788581616.367461:0:23362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b31739 00000100:00080000:0.0:1788581616.367472:0:23362:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788581616.367477:0:23362:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff995e6f8e2800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581616.367519:0:23362:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e45153480 x1875463184285824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788581616.367572:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184285824:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788581616.367635:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184285824 offset 0 length 520: 4 00000100:00080000:2.0:1788581616.367968:0:23362:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788581616.368025:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581616.368030:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.368032:0:23362:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788581616.368035:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581616.368039:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.368040:0:23362:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788581616.368043:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788581616.368045:0:23362:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788581616.368048:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581616.368049:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.368051:0:23362:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788581616.368061:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581616.368064:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.368065:0:23362:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788581616.368069:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788581616.368099:0:23362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581616.368102:0:23362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.368104:0:23362:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788581616.368107:0:23362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:0.0:1788581616.368282:0:23358:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788581616.368309:0:23358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788581616.368325:0:23358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43273a00/0x50f0cc74b7b316bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b316c2 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.368335:0:23358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995d43273a00/0x50f0cc74b7b316bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b316c2 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581616.368343:0:23358:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e6be35800 from 1 10000000:01000000:0.0:1788581616.368345:0:23358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788581616.368370:0:23358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b31740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.368394:0:23358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b31740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.368406:0:23358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b31740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581616.368424:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184285952:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788581616.368465:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581616.368492:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c38600 going to sleep for 11 seconds 00000100:00100000:3.0:1788581616.368740:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184285952 00000100:00100000:3.0:1788581616.368748:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184285952 00000100:00100000:3.0:1788581616.368956:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788581616.368968:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+15:23358:x1875463184285952:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581616.368989:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581616.369002:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b31747 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b31740 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581616.369025:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b31747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b31740 expref: 16 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581616.369035:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b31747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31740 expref: 16 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581616.369044:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6a800, rc 0) 00000100:00100000:3.0:1788581616.369095:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+16:23358:x1875463184285952:12345-0@lo:101:mount.lustre.0 Request processed in 129us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581616.369103:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788581616.369173:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184285952:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581616.369188:0:23358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b31740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31747 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.369197:0:23358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b31740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31747 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581616.369828:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184286080:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788581616.369869:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788581616.370243:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581616.370250:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788581616.370267:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581616.370270:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788581616.370411:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c38600 going to sleep for 11 seconds 00000100:00100000:1.0:1788581616.370469:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184286080 00000100:00100000:1.0:1788581616.370476:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184286080 00000100:00100000:1.0:1788581616.370511:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788581616.370519:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+16:23358:x1875463184286080:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788581616.370536:0:22620:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788581616.370553:0:22620:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788581616.370556:0:22620:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788581616.370664:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+16:23358:x1875463184286080:12345-0@lo:256:mount.lustre.0 Request processed in 145us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581616.370677:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788581616.370760:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184286080:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788581616.371587:0:23358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788581616.371602:0:23358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b31740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31747 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.371612:0:23358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b31740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31747 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581616.371633:0:23358:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e6be35800 from 1 10000000:01000000:0.0:1788581616.371636:0:23358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581616.371664:0:23358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3174e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.371671:0:23358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3174e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.371679:0:23358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3174e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581616.371696:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184286208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788581616.371734:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581616.371750:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c38600 going to sleep for 11 seconds 00000100:00100000:1.0:1788581616.371976:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184286208 00000100:00100000:1.0:1788581616.371982:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184286208 00000100:00100000:1.0:1788581616.372011:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788581616.372018:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+16:23358:x1875463184286208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581616.372028:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581616.372039:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42cca000/0x50f0cc74b7b31755 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b3174e expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.372058:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42cca000/0x50f0cc74b7b31755 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b3174e expref: 17 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.372068:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42cca000/0x50f0cc74b7b31755 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b3174e expref: 17 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.372076:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42cca000, rc 0) 00000100:00100000:1.0:1788581616.372114:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:23358:x1875463184286208:12345-0@lo:101:mount.lustre.0 Request processed in 96us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581616.372121:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788581616.372211:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184286208:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581616.372224:0:23358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3174e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31755 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.372232:0:23358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3174e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31755 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788581616.373600:0:23358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1788581616.374028:0:23358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788581616.374204:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788581616.374227:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1788581616.374240:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1788581616.374335:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788581616.374704:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788581616.374721:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788581616.374733:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1788581616.374744:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1788581616.374756:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788581616.374766:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1788581616.374777:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1788581616.374923:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1788581616.374931:0:23358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1788581616.375016:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184286336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581616.375078:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581616.375164:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e662ab300 going to sleep for 11 seconds 00000100:00100000:1.0:1788581616.375203:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184286336 00000100:00100000:1.0:1788581616.375209:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184286336 00000100:00100000:3.0:1788581616.375424:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788581616.375435:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:23358:x1875463184286336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581616.375594:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:23358:x1875463184286336:12345-0@lo:501:mount.lustre.0 Request processed in 161us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581616.375602:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788581616.375718:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184286336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581616.375763:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184286464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788581616.375891:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581616.375920:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c38e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581616.375968:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184286464 00000100:00100000:1.0:1788581616.375972:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184286464 00000100:00100000:1.0:1788581616.376000:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788581616.376006:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:23358:x1875463184286464:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581616.376084:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:23358:x1875463184286464:12345-0@lo:503:mount.lustre.0 Request processed in 78us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581616.376091:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788581616.376188:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184286464:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788581616.376561:0:23358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788581616.376732:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184286592:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581616.376769:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581616.376799:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c38600 going to sleep for 11 seconds 00000100:00100000:1.0:1788581616.376908:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184286592 00000100:00100000:1.0:1788581616.376913:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184286592 00000100:00100000:1.0:1788581616.376945:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788581616.376952:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:23358:x1875463184286592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581616.377028:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:23358:x1875463184286592:12345-0@lo:502:mount.lustre.0 Request processed in 76us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581616.377035:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788581616.377118:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184286592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581616.377297:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788581616.377331:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1788581616.377344:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1788581616.377355:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1788581616.377365:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1788581616.377388:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1788581616.377401:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1788581616.377412:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1788581616.377423:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788581616.377433:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1788581616.377444:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1788581616.377477:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184286720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581616.377508:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581616.377519:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c38600 going to sleep for 11 seconds 00000100:00100000:1.0:1788581616.377929:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184286720 00000100:00100000:1.0:1788581616.377935:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184286720 00000100:00100000:1.0:1788581616.377966:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788581616.377973:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:23358:x1875463184286720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581616.378042:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:23358:x1875463184286720:12345-0@lo:502:mount.lustre.0 Request processed in 69us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581616.378049:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788581616.378100:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184286720:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581616.378144:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1788581616.378151:0:23358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788581616.378775:0:23372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581616.378784:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.378787:0:23372:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788581616.378911:0:23372:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e6be35800 00000020:00000080:2.0:1788581616.378914:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788581616.378922:0:23372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581616.378929:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.378931:0:23372:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788581616.378934:0:23372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581616.378936:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.378937:0:23372:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788581616.378941:0:23372:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e6be35800 00000020:00000080:2.0:1788581616.378943:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788581616.378996:0:23372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581616.378999:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.379000:0:23372:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788581616.379002:0:23372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581616.379004:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.379006:0:23372:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788581616.379009:0:23372:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e6be35800 00000020:00000080:2.0:1788581616.379011:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788581616.379026:0:23372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581616.379028:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.379030:0:23372:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788581616.379032:0:23372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581616.379033:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.379035:0:23372:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788581616.379038:0:23372:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e6be35800 00000020:00000080:2.0:1788581616.379040:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788581616.379059:0:23372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581616.379061:0:23372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581616.379062:0:23372:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788581616.379065:0:23372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1788581616.380001:0:23358:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788581616.380034:0:23358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581616.380057:0:23358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3174e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31755 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.380069:0:23358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3174e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31755 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581616.380123:0:23358:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788581616.380126:0:23358:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff995e6be35800 10000000:01000000:1.0:1788581616.380129:0:23358:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff995e6be35800 10000000:01000000:1.0:1788581616.380141:0:23358:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788581616.380147:0:23358:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e6be35800 from 1 10000000:01000000:1.0:1788581616.380150:0:23358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788581616.380181:0:23358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42ccae00/0x50f0cc74b7b3175c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.380189:0:23358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42ccae00/0x50f0cc74b7b3175c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.380199:0:23358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42ccae00/0x50f0cc74b7b3175c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581616.380223:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184286848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788581616.380304:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581616.380342:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184286848 00000100:00100000:1.0:1788581616.380350:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184286848 00000100:00100000:1.0:1788581616.380401:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788581616.380409:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:23358:x1875463184286848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581616.380422:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581616.380434:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42cca600/0x50f0cc74b7b31763 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b3175c expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.380454:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42cca600/0x50f0cc74b7b31763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b3175c expref: 18 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.380464:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42cca600/0x50f0cc74b7b31763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b3175c expref: 18 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.380472:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42cca600, rc 0) 00000100:00100000:1.0:1788581616.380499:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:23358:x1875463184286848:12345-0@lo:101:mount.lustre.0 Request processed in 91us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581616.380513:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788581616.380555:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a48ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581616.381976:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184286848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581616.382002:0:23358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42ccae00/0x50f0cc74b7b3175c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31763 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.382013:0:23358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42ccae00/0x50f0cc74b7b3175c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31763 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581616.388977:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00000040:00080000:2.0:1788581616.395797:0:23358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788581616.396114:0:23358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788581616.396341:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788581616.396367:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788581616.396396:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788581616.396411:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788581616.396435:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788581616.396449:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788581616.396460:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788581616.396473:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788581616.396486:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788581616.396500:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788581616.396512:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788581616.396524:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788581616.396538:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788581616.396565:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788581616.398120:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788581616.398152:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788581616.398166:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788581616.398180:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788581616.398194:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788581616.398207:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788581616.398219:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788581616.398232:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788581616.398245:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788581616.398291:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788581616.398307:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788581616.398321:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788581616.398336:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788581616.398351:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788581616.398365:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788581616.398412:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788581616.398429:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788581616.398442:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788581616.398454:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788581616.398469:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788581616.398483:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788581616.398497:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788581616.398509:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788581616.398533:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788581616.398548:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788581616.398565:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788581616.400762:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788581616.400929:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788581616.400946:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788581616.400958:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788581616.400970:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788581616.400982:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788581616.401013:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788581616.401028:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788581616.401180:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788581616.401198:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788581616.401213:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788581616.401218:0:23358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788581616.401350:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184286976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581616.401424:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581616.401471:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e524fad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581616.401912:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184286976 00000100:00100000:0.0:1788581616.401920:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184286976 00000100:00100000:0.0:1788581616.401974:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788581616.401984:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:23358:x1875463184286976:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581616.402117:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:23358:x1875463184286976:12345-0@lo:501:mount.lustre.0 Request processed in 134us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581616.402124:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788581616.403741:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184286976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581616.404691:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184287104:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581616.404755:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581616.404857:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e524fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581616.405088:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184287104 00000100:00100000:3.0:1788581616.405095:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184287104 00000100:00100000:3.0:1788581616.405140:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788581616.405149:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:23358:x1875463184287104:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788581616.405287:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:23358:x1875463184287104:12345-0@lo:503:mount.lustre.0 Request processed in 138us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581616.405295:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788581616.406117:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184287104:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788581616.406624:0:23358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788581616.406704:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184287232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581616.406763:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581616.406813:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e524fad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581616.411779:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184287232 00000100:00100000:1.0:1788581616.411896:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184287232 00000100:00100000:1.0:1788581616.411948:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788581616.411957:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:23358:x1875463184287232:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581616.412250:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:23358:x1875463184287232:12345-0@lo:502:mount.lustre.0 Request processed in 294us (5486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581616.412321:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788581616.414559:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184287232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788581616.415049:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788581616.415085:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1788581616.415102:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1788581616.415116:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1788581616.415130:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1788581616.415143:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1788581616.415157:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1788581616.415185:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1788581616.415200:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788581616.415212:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1788581616.415225:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1788581616.415237:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1788581616.415249:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1788581616.415299:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1788581616.415314:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1788581616.415327:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1788581616.415340:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1788581616.415351:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1788581616.415364:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1788581616.415390:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1788581616.415405:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1788581616.415416:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1788581616.415428:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1788581616.415454:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1788581616.415470:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1788581616.415483:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1788581616.415494:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1788581616.415504:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1788581616.415516:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1788581616.415589:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1788581616.415608:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1788581616.415619:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1788581616.415643:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1788581616.415657:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1788581616.415671:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1788581616.415685:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1788581616.415696:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1788581616.415709:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1788581616.415721:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1788581616.415747:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1788581616.415764:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1788581616.415776:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1788581616.415790:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1788581616.415900:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1788581616.415925:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1788581616.415939:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1788581616.415953:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1788581616.415966:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1788581616.416016:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184287360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581616.416082:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581616.416125:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e524fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581616.416306:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184287360 00000100:00100000:3.0:1788581616.416318:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184287360 00000100:00100000:3.0:1788581616.416362:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788581616.416371:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:23358:x1875463184287360:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581616.416503:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:23358:x1875463184287360:12345-0@lo:502:mount.lustre.0 Request processed in 132us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581616.416510:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788581616.416612:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184287360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788581616.416768:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788581616.416909:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788581616.416937:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184287488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581616.416973:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581616.416999:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e524fad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581616.417166:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184287488 00000100:00100000:1.0:1788581616.417170:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184287488 00000100:00100000:1.0:1788581616.417197:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788581616.417204:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4580b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:23358:x1875463184287488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581616.417311:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4580b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:23358:x1875463184287488:12345-0@lo:502:mount.lustre.0 Request processed in 106us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581616.417317:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788581616.417725:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184287488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788581616.417774:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1788581616.417783:0:23358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788581616.419029:0:23377:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788581616.419044:0:23377:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff995e4e374d28) 00000020:00000080:0.0:1788581616.419063:0:23377:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788581616.419148:0:23377:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e6be35800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788581616.419152:0:23377:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e6be35800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788581616.419154:0:23377:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e6be35800 3 00010000:00080000:0.0:1788581616.419182:0:23377:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995d422b8800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1788581616.424147:0:23377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788581616.425167:0:23377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788581616.425213:0:23377:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788581616.425225:0:23377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x50f0cc74b7b31771 00000100:00080000:2.0:1788581616.425235:0:23377:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788581616.425241:0:23377:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff995d422b8800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581616.425442:0:23377:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e550aea00 x1875463184287616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788581616.425462:0:23377:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788581616.425483:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875463184287616:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788581616.425484:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581616.425488:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788581616.425491:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581616.425494:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788581616.425547:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581616.425608:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184287616 00000100:00100000:3.0:1788581616.425615:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184287616 00000100:00100000:3.0:1788581616.425640:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788581616.425647:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875463184287616:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788581616.425667:0:22628:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 602 last 0 00000020:00000080:3.0:1788581616.425706:0:22628:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x50f0cc74b7b31778 00000004:00100000:3.0:1788581616.425720:0:22628:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788581616.425746:0:22628:0:(import.c:65:import_set_state_nolock()) ffff995d43bf3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581616.425864:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875463184287616:12345-0@lo:38:llog_process_th.0 Request processed in 142us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581616.425873:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788581616.425908:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff995e550aea00 x1875463184287616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581616.425918:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788581616.425925:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788581616.425931:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788581616.425935:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788581616.425937:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d422b8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788581616.425948:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875463184287616:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788581616.429053:0:23377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1788581616.429170:0:23358:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788581616.429204:0:23358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788581616.429223:0:23358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42ccae00/0x50f0cc74b7b3175c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31763 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581616.429236:0:23358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42ccae00/0x50f0cc74b7b3175c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31763 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788581616.429315:0:23358:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788581616.429317:0:23358:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788581616.429319:0:23358:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581616.429320:0:23358:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581616.429321:0:23358:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581616.429322:0:23358:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581616.429324:0:23358:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788581616.429325:0:23358:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581616.429326:0:23358:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788581616.429330:0:23358:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788581616.429332:0:23358:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788581616.429333:0:23358:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788581616.429334:0:23358:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581616.429335:0:23358:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581616.429336:0:23358:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581616.429337:0:23358:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581616.429338:0:23358:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788581616.429339:0:23358:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581616.429340:0:23358:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788581616.429365:0:23358:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788581616.429396:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43836680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184287744:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788581616.429460:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581616.429497:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184287744 00000100:00100000:3.0:1788581616.429504:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184287744 00000100:00100000:3.0:1788581616.429553:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788581616.429561:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4580a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:23358:x1875463184287744:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788581616.429598:0:22620:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788581616.429610:0:22620:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788581616.430323:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a617e40 going to sleep for 11 seconds 00000001:00100000:3.0:1788581616.431620:0:22607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788581616.431653:0:22620:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788581616.431707:0:22620:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788581616.432054:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4580a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:23358:x1875463184287744:12345-0@lo:253:mount.lustre.0 Request processed in 2489us (2588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581616.432066:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788581616.432156:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43836680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:23358:1875463184287744:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788581616.432176:0:23358:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788581616.432179:0:23358:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788581616.432180:0:23358:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788581616.432182:0:23358:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581616.432183:0:23358:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581616.432184:0:23358:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581616.432185:0:23358:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581616.432187:0:23358:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788581616.432188:0:23358:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581616.432190:0:23358:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788581616.432210:0:23358:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788581616.432967:0:22642:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788581616.432974:0:22642:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788581616.432994:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995d43272c00/0x50f0cc74b7b3177f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.433012:0:22642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b31683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b3167c expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.433021:0:22642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b31747 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31740 expref: 17 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.433518:0:22642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995d43272c00/0x50f0cc74b7b3177f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.433557:0:22642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b31747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b31740 expref: 17 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.433572:0:22642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b31747 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b31740 expref: 17 pid: 22622 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581616.433663:0:22642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45150700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875463184287872:0@lo:104: 00000100:00100000:0.0:1788581616.434233:0:22642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581616.434337:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184287872 00000100:00100000:1.0:1788581616.434346:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184287872 00010000:00010000:0.0:1788581616.434384:0:22642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b31683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b3167c expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.434395:0:22642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b31683 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b3167c expref: 17 pid: 22621 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581616.434397:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788581616.434405:0:22642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875463184288000:0@lo:104: 00000100:00100000:1.0:1788581616.434406:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45153800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+3:22642:x1875463184287872:12345-0@lo:104: 00010000:00010000:1.0:1788581616.434418:0:22611:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b31740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b31747 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581616.434427:0:22642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581616.434437:0:22642:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c38600 going to sleep for 11 seconds 00010000:00010000:1.0:1788581616.434467:0:22611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788581616.434473:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45153800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+3:22642:x1875463184287872:12345-0@lo:104: Request processed in 69us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581616.434475:0:22642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45150700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875463184287872:0@lo:104: 00000100:00100000:1.0:1788581616.434480:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581616.434492:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184288000 00000100:00100000:1.0:1788581616.434496:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184288000 00000100:00100000:1.0:1788581616.434509:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581616.434515:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+3:22642:x1875463184288000:12345-0@lo:104: 00010000:00010000:1.0:1788581616.434522:0:22611:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3167c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b31683 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.434565:0:22611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788581616.434570:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+3:22642:x1875463184288000:12345-0@lo:104: Request processed in 55us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581616.434583:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581616.434663:0:22642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875463184288000:0@lo:104: 00010000:00010000:0.0:1788581616.434691:0:22642:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995d43272c00/0x50f0cc74b7b3177f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.434928:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581616.434935:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b31740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b31747 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.434941:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43273000 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581616.434945:0:22616:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b31740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b31747 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.434952:0:22616:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b31740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b31747 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581616.434959:0:22616:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b31740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b31747 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581616.434964:0:22616:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581616.434991:0:22616:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b31740 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31747 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.434998:0:22616:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581616.435015:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b31740 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31747 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435021:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b31740 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31747 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435032:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581616.435034:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3167c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b31683 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435050:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6ba00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581616.435054:0:22616:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3167c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b31683 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435060:0:22616:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3167c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b31683 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581616.435065:0:22616:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3167c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b31683 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581616.435069:0:22616:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581616.435082:0:22616:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3167c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31683 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435088:0:22616:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581616.435101:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3167c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31683 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435108:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3167c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31683 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435121:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581616.435123:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581616.435124:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581616.435131:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581616.435147:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a361c037-f8ee-420d-b76d-dbdb9328e15d:3619:1875463184288128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581616.435176:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581616.435218:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184288256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581616.435273:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581616.435296:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184288128 00000100:00100000:0.0:1788581616.435301:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184288128 00000100:00100000:1.0:1788581616.435321:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184288256 00010000:00010000:0.0:1788581616.435321:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b31747 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b31740 expref: 18 pid: 22622 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581616.435324:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184288256 00010000:00010000:1.0:1788581616.435334:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b31683 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b3167c expref: 19 pid: 22621 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581616.435346:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788581616.435353:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+19:3619:x1875463184288128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581616.435363:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581616.435369:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b31747 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b31740 expref: 19 pid: 22622 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.435398:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b31747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b31740 expref: 19 pid: 22622 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.435411:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6a800/0x50f0cc74b7b31747 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b31740 expref: 19 pid: 22622 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581616.435423:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581616.435458:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:3619:x1875463184288128:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581616.435803:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581616.435813:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:3620:x1875463184288256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581616.435821:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581616.435826:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b31683 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b3167c expref: 18 pid: 22621 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435836:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b31683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b3167c expref: 18 pid: 22621 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435846:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0f600/0x50f0cc74b7b31683 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b3167c expref: 18 pid: 22621 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435857:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995d43272c00/0x50f0cc74b7b3177f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435865:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43272c00/0x50f0cc74b7b3177f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788581616.435878:0:22613:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.026306895s 00010000:00010000:1.0:1788581616.435883:0:22613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995d43272c00/0x50f0cc74b7b3177f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435889:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995d43272c00/0x50f0cc74b7b3177f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435905:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995d43272c00/0x50f0cc74b7b3177f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435911:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995d43272c00/0x50f0cc74b7b3177f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435916:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272c00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581616.435920:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995d43272c00/0x50f0cc74b7b3177f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435927:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995d43272c00/0x50f0cc74b7b3177f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435940:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995d43272c00/0x50f0cc74b7b3177f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.435949:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581616.435979:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:3620:x1875463184288256:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581616.435985:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581616.436015:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184288256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581616.436039:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a361c037-f8ee-420d-b76d-dbdb9328e15d:3619:1875463184288128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581616.436055:0:22642:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995d43272c00/0x50f0cc74b7b3177f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.436063:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995d43272c00/0x50f0cc74b7b3177f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581616.436078:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995d43272c00/0x50f0cc74b7b3177f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581616.436707:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:01000000:1.0:1788581616.438873:0:23358:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1788581616.443839:0:23384:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788581616.444008:0:23358:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1788581616.444385:0:23384:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1788581616.446400:0:23383:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788581616.446408:0:23383:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:1.0:1788581616.447191:0:23384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788581616.447289:0:23384:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1788581616.447836:0:23358:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788581616.447879:0:23358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788581616.448411:0:23385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43834e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23385:1875463184288384:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788581616.448477:0:23385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581616.448517:0:23385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a617a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581616.448573:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184288384 00000100:00100000:0.0:1788581616.448580:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184288384 00000100:00100000:0.0:1788581616.448631:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581616.448642:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23385:x1875463184288384:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788581616.448722:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23385:x1875463184288384:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 82us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581616.448729:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788581616.449030:0:23385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43834e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23385:1875463184288384:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788581616.449067:0:23385:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788581616.449095:0:23385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23385:1875463184288512:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788581616.449128:0:23385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581616.449154:0:23385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47fb0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581616.449199:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184288512 00000100:00100000:0.0:1788581616.449204:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184288512 00000100:00100000:0.0:1788581616.449234:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581616.449241:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23385:x1875463184288512:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788581616.449386:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23385:x1875463184288512:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 134us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581616.449394:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581616.449458:0:23385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23385:1875463184288512:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788581616.449509:0:23385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23385:1875463184288640:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788581616.449536:0:23385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581616.449558:0:23385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a617600 going to sleep for 11 seconds 00000100:00100000:0.0:1788581616.449607:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184288640 00000100:00100000:0.0:1788581616.449616:0:22637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184288640 00000100:00100000:0.0:1788581616.449653:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788581616.449659:0:22637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23385:x1875463184288640:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788581616.449696:0:22637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23385:x1875463184288640:12345-0@lo:900:lod0001_rec0000.0 Request processed in 37us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581616.449702:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788581616.449759:0:23385:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff995d43835180 x1875463184288640/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788581632 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581616.449769:0:23385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23385:1875463184288640:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788581616.449807:0:23385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23385:1875463184288768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788581616.449831:0:23385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581616.449852:0:23385:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a617a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581616.449905:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184288768 00000100:00100000:1.0:1788581616.449909:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184288768 00000100:00100000:1.0:1788581616.449934:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581616.449940:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23385:x1875463184288768:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788581616.450013:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23385:x1875463184288768:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 73us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581616.450019:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581616.450079:0:23385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23385:1875463184288768:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788581616.450125:0:23385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581616.452136:0:23385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788581616.452212:0:23385:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788581616.452217:0:23385:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000004:00000080:2.0:1788581616.452858:0:23358:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788581616.452875:0:23358:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788581616.452968:0:23358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788581616.454049:0:23358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788581616.454648:0:23358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788581616.454681:0:23358:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788581616.454795:0:23358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788581616.455306:0:23358:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:2.0:1788581616.462871:0:23358:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788581616.470469:0:23358:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788581616.470510:0:23358:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffabf141ec3988 00100000:10000000:2.0:1788581616.470519:0:23358:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788581616.476625:0:23358:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788581616.476658:0:23358:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788581616.476687:0:23358:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788581616.476705:0:23358:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788581616.477521:0:23358:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788581616.477739:0:23358:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788581616.897532:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581617.409418:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00000040:00080000:2.0:1788581617.475724:0:23380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788581617.921628:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788581618.050322:0:22624:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788581618.050329:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e6be35800 from 12 10000000:01000000:1.0:1788581618.050334:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788581618.050402:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31786 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581618.050434:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31786 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581618.050446:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31786 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581618.050470:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184288896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788581618.050537:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581618.050583:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47fb0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788581618.051046:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184288896 00000100:00100000:2.0:1788581618.051055:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184288896 00000100:00100000:2.0:1788581618.051113:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788581618.051124:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+16:22624:x1875463184288896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581618.051137:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581618.051151:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b3178d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b31786 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581618.051175:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b3178d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b31786 expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581618.051186:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b3178d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31786 expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581618.051195:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0ec00, rc 0) 00000100:00100000:2.0:1788581618.051274:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:22624:x1875463184288896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581618.051281:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788581618.051394:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184288896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581618.051410:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31786 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3178d expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581618.051420:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31786 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b3178d expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581618.051479:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184289024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788581618.051515:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581618.051546:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47fb0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788581618.051615:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184289024 00000100:00100000:3.0:1788581618.051620:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184289024 00000100:00100000:3.0:1788581618.051657:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788581618.051666:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4580a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:22624:x1875463184289024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788581618.051681:0:22622:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788581618.051698:0:22622:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788581618.051701:0:22622:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788581618.051789:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4580a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:22624:x1875463184289024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581618.051796:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788581618.051829:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184289024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788581618.051872:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788581618.051880:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31786 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3178d expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581618.051888:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3178d expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581618.051898:0:22624:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788581618.051900:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e7f798800 from 12 10000000:01000000:3.0:1788581618.051903:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788581618.051921:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b31794 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581618.051939:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b31794 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581618.051948:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b31794 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581618.051961:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184289152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581618.051987:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581618.052010:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a6176c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581618.052022:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184289152 00000100:00100000:3.0:1788581618.052025:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184289152 00000100:00100000:3.0:1788581618.052045:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788581618.052051:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:22624:x1875463184289152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581618.052058:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581618.052067:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b3179b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b31794 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581618.052082:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b3179b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b31794 expref: 18 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581618.052091:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b3179b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31794 expref: 18 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581618.052100:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6ae00, rc 0) 00000100:00100000:2.0:1788581618.052376:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184289152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581618.052388:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b31794 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3179b expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581618.052397:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b31794 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b3179b expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581618.052805:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184289280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788581618.052838:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581618.052855:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d1f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581618.052873:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184289280 00000100:00100000:2.0:1788581618.052877:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184289280 00000100:00100000:2.0:1788581618.052905:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788581618.052912:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4580ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+19:22624:x1875463184289280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788581618.052925:0:22620:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788581618.052938:0:22620:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788581618.052941:0:22620:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788581618.053016:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4580ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+19:22624:x1875463184289280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581618.053023:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788581618.053058:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184289280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788581618.053093:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788581618.053101:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b31794 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3179b expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581618.053108:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b31794 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3179b expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581618.053242:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:22624:x1875463184289152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581618.053250:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788581618.433930:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00000040:00080000:3.0:1788581618.502056:0:23380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788581618.945643:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581619.460631:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00010000:00010000:3.0:1788581619.969739:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581620.490239:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00010000:00010000:3.0:1788581620.998567:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788581621.123080:0:23628:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788581621.505350:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 0 seconds 00000100:00100000:0.0:1788581621.570943:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184289408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581621.571013:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581621.571083:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184289408 00000100:00100000:0.0:1788581621.571090:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184289408 00000100:00100000:0.0:1788581621.571135:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788581621.571144:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184289408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788581621.571187:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788581621.571234:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184289408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581621.571240:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788581621.571305:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184289408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581621.574565:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a361c037-f8ee-420d-b76d-dbdb9328e15d:3618:1875463184289536:0@lo:400:kworker.0 00000100:00100000:1.0:1788581621.574649:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581621.574726:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184289536 00000100:00100000:0.0:1788581621.574734:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184289536 00000100:00100000:0.0:1788581621.574794:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788581621.574803:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4580b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:3618:x1875463184289536:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788581621.574918:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788581621.574923:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788581621.574927:0:36:0:(import.c:65:import_set_state_nolock()) ffff995e42f11800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581621.574934:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff995e42f11800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581621.574959:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43835880 x1875463184289664/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581621.574972:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581621.574975:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788581621.574977:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581621.574980:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788581621.579574:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184289792:0@lo:400:kworker.0 00000100:00100000:1.0:1788581621.579794:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a361c037-f8ee-420d-b76d-dbdb9328e15d:3618:1875463184289536:0@lo:400:kworker.0 00000100:00080000:3.0:1788581621.579995:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581621.580001:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788581621.580004:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581621.580008:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788581621.580067:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184289664:0@lo:38:kworker.0 00000100:00100000:0.0:1788581621.584034:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4580b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:3618:x1875463184289536:12345-0@lo:400:kworker.0 Request processed in 9220us (9371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581621.584051:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788581621.584164:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184289920:0@lo:400:kworker.0 00000100:00100000:2.0:1788581621.584314:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581621.587925:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581621.588041:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184289792 00000100:00100000:1.0:1788581621.588059:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184289792 00000100:00100000:1.0:1788581621.588110:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184289920 00000100:00100000:1.0:1788581621.588113:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184289920 00000100:00100000:1.0:1788581621.588130:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581621.588138:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184289792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581621.588208:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184289792:12345-0@lo:400:kworker.0 Request processed in 71us (3895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581621.588215:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581621.588231:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581621.588237:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184289920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581621.588290:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184289920:12345-0@lo:400:kworker.0 Request processed in 53us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581621.588295:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788581621.588334:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995d43834000 x1875463184289792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581621.588361:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184289792:0@lo:400:kworker.0 00010000:00080000:0.0:1788581621.588509:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995d43834700 x1875463184289920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581621.588519:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184289920:0@lo:400:kworker.0 00000100:00100000:3.0:1788581621.593009:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581621.593138:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184289664 00000100:00100000:0.0:1788581621.593147:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184289664 00000100:00100000:0.0:1788581621.593204:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788581621.593211:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3617:x1875463184289664:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788581621.593241:0:23367:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:0.0:1788581621.593296:0:23367:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b317a2 00000004:00100000:0.0:1788581621.593312:0:23367:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788581621.593317:0:23367:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1788581621.613679:0:23367:0:(import.c:65:import_set_state_nolock()) ffff995e6fad9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581621.614943:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875463184289664:12345-0@lo:38:kworker.0 Request processed in 21724us (21935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581621.614955:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788581621.619105:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788581621.619119:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788581621.619126:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788581621.619130:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e42f11800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788581621.619144:0:3617:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002c707d46): req@ffff995d43836d80 x1875463184282624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581621.619168:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184289664:0@lo:38:kworker.0 00000100:00100000:2.0:1788581621.619496:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581621.619498:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581621.619512:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184290048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581621.619527:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 11 seconds 00000100:00100000:0.0:1788581621.619538:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581621.619581:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184282624 00000100:00100000:0.0:1788581621.619587:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184282624 00000100:00100000:2.0:1788581621.619611:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184290048 00000100:00100000:2.0:1788581621.619615:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184290048 00000100:00100000:0.0:1788581621.619819:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788581621.620930:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22668:x1875463184282624:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788581621.621041:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22668:x1875463184282624:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 116us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581621.625464:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788581621.625488:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3620:x1875463184290048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788581621.625530:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788581621.625857:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3620:x1875463184290048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 379us (6316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581621.625866:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581621.626606:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43836d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22668:1875463184282624:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788581621.626658:0:22668:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788581621.626707:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766ead80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22668:1875463184290176:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788581621.626759:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581621.626806:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788581621.627894:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184290176 00000100:00100000:2.0:1788581621.627904:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184290176 00000100:00100000:2.0:1788581621.627942:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788581621.627951:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22668:x1875463184290176:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788581621.628171:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22668:x1875463184290176:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 221us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581621.628179:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788581621.628216:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766ead80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22668:1875463184290176:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788581621.628272:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788581621.628336:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184290048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581621.628966:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550af480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22668:1875463184290304:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788581621.629003:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581621.629027:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a48e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581621.635092:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184290304 00000100:00100000:3.0:1788581621.635121:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184290304 00000100:00100000:3.0:1788581621.635188:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788581621.635199:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22668:x1875463184290304:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788581621.638649:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22668:x1875463184290304:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 3445us (9637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581621.638663:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788581621.638723:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550af480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22668:1875463184290304:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788581621.638783:0:22668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788581621.641109:0:22668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788581621.641208:0:22668:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:2.0:1788581621.641213:0:22668:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788581622.022565:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788581622.136753:0:23680:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788581622.137048:0:23680:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1788581623.016469:0:23730:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788581623.016674:0:23730:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788581623.049280:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581624.067088:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788581624.207090:0:23778:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc82aaaed0 20000000:00000080:1.0:1788581624.207108:0:23778:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff995e46f29c00 uarg=0000000000000000 20000000:01000000:1.0:1788581624.207146:0:23778:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788581624.207158:0:23778:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788581624.207162:0:23778:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788581624.207945:0:23779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788581624.208195:0:23778:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788581624.215004:0:23778:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788581624.215086:0:23778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995d43272200/0x50f0cc74b7b317a9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581624.215106:0:23778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b31652 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b3164b expref: 17 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581624.215114:0:23778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42cca000/0x50f0cc74b7b31755 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b3174e expref: 17 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581624.215122:0:23778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995d43272200/0x50f0cc74b7b317a9 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581624.215164:0:23778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42cca000/0x50f0cc74b7b31755 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b3174e expref: 17 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581624.215178:0:23778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e42cca000/0x50f0cc74b7b31755 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b3174e expref: 17 pid: 22620 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581624.215192:0:23778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23778:1875463184290432:0@lo:104: 00000100:00100000:0.0:1788581624.215894:0:23778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788581624.215988:0:23778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b31652 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b3164b expref: 17 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581624.216000:0:23778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b31652 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b3164b expref: 17 pid: 22622 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581624.216020:0:23778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45153100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23778:1875463184290560:0@lo:104: 00000100:00100000:0.0:1788581624.216051:0:23778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581624.216177:0:23778:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81db0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788581624.216222:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184290432 00000100:00100000:1.0:1788581624.216229:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184290432 00000100:00100000:2.0:1788581624.216398:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184290560 00000100:00100000:2.0:1788581624.216402:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184290560 00000100:00100000:2.0:1788581624.216426:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581624.216435:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45152680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+4:23778:x1875463184290432:12345-0@lo:104: 00010000:00010000:2.0:1788581624.216447:0:22611:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3174e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b31755 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581624.216556:0:22611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788581624.216563:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45152680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+4:23778:x1875463184290432:12345-0@lo:104: Request processed in 129us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581624.216570:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581624.216587:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788581624.216593:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45150a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+3:23778:x1875463184290560:12345-0@lo:104: 00010000:00010000:2.0:1788581624.216601:0:22611:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b3164b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b31652 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581624.216705:0:23778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23778:1875463184290432:0@lo:104: 00000100:00100000:0.0:1788581624.216713:0:23778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45153100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23778:1875463184290560:0@lo:104: 00010000:00010000:0.0:1788581624.216734:0:23778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995d43272200/0x50f0cc74b7b317a9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581624.216902:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581624.216910:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3174e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b31755 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581624.216919:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43273400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581624.216923:0:22616:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3174e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b31755 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581624.216932:0:22616:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3174e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b31755 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581624.216939:0:22616:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3174e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b31755 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581624.216945:0:22616:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788581624.217020:0:22616:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3174e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31755 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581624.217027:0:22616:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581624.217051:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3174e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31755 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581624.217059:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995d43273400/0x50f0cc74b7b3174e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31755 expref: -99 pid: 23358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581624.217086:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581624.217089:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b3164b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b31652 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581624.217094:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43273e00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788581624.217097:0:22616:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b3164b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b31652 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581624.217104:0:22616:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b3164b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b31652 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581624.217110:0:22616:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b3164b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b31652 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581624.217116:0:22616:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788581624.217155:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a361c037-f8ee-420d-b76d-dbdb9328e15d:3618:1875463184290688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581624.217189:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581624.217234:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184290688 00000100:00100000:1.0:1788581624.217239:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184290688 00010000:00010000:1.0:1788581624.217280:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42cca000/0x50f0cc74b7b31755 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b3174e expref: 18 pid: 22620 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581624.217314:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581624.217322:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:3618:x1875463184290688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581624.217343:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581624.217348:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42cca000/0x50f0cc74b7b31755 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b3174e expref: 18 pid: 22620 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581624.217358:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42cca000/0x50f0cc74b7b31755 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b3174e expref: 18 pid: 22620 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581624.217371:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42cca000/0x50f0cc74b7b31755 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b3174e expref: 18 pid: 22620 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581624.217381:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581624.217410:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:3618:x1875463184290688:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581624.217417:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581624.217445:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a361c037-f8ee-420d-b76d-dbdb9328e15d:3618:1875463184290688:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581624.217578:0:22611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788581624.217585:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45150a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+3:23778:x1875463184290560:12345-0@lo:104: Request processed in 992us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581624.217593:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788581624.217691:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581624.217896:0:22616:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b3164b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31652 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581624.217903:0:22616:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581624.217935:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b3164b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31652 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581624.217942:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995d43273e00/0x50f0cc74b7b3164b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31652 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581624.217957:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581624.217959:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581624.217961:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581624.218001:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a361c037-f8ee-420d-b76d-dbdb9328e15d:3619:1875463184290816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581624.218031:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581624.218123:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184290816 00000100:00100000:2.0:1788581624.218128:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184290816 00010000:00010000:2.0:1788581624.218146:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b31652 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b3164b expref: 17 pid: 22622 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581624.218175:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788581624.218183:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:3619:x1875463184290816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581624.218192:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581624.218196:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b31652 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b3164b expref: 17 pid: 22622 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581624.218206:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b31652 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b3164b expref: 17 pid: 22622 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581624.218218:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0f000/0x50f0cc74b7b31652 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b3164b expref: 17 pid: 22622 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581624.218230:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995d43272200/0x50f0cc74b7b317a9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581624.218238:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43272200/0x50f0cc74b7b317a9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581624.218493:0:22613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995d43272200/0x50f0cc74b7b317a9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581624.218502:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995d43272200/0x50f0cc74b7b317a9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581624.218509:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995d43272200/0x50f0cc74b7b317a9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581624.218516:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995d43272200/0x50f0cc74b7b317a9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581624.218521:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581624.218526:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995d43272200/0x50f0cc74b7b317a9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581624.218533:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995d43272200/0x50f0cc74b7b317a9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581624.218555:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995d43272200/0x50f0cc74b7b317a9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581624.218565:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581624.218607:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+16:3619:x1875463184290816:12345-0@lo:103:ldlm_bl.0 Request processed in 425us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581624.218614:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581624.218673:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a361c037-f8ee-420d-b76d-dbdb9328e15d:3619:1875463184290816:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581624.218724:0:23778:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995d43272200/0x50f0cc74b7b317a9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581624.218733:0:23778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995d43272200/0x50f0cc74b7b317a9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581624.218739:0:23778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995d43272200/0x50f0cc74b7b317a9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581625.089446:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581625.537994:0:22661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788581625.602137:0:22624:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788581625.602144:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e6be35800 from 13 10000000:01000000:0.0:1788581625.602150:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581625.602199:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b317b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581625.602210:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b317b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581625.602222:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b317b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581625.602246:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45153100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184290944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788581625.603759:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581625.603804:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81db0900 going to sleep for 11 seconds 00000100:00100000:3.0:1788581625.603852:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184290944 00000100:00100000:3.0:1788581625.603861:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184290944 00000100:00100000:3.0:1788581625.603920:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788581625.603930:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+16:22624:x1875463184290944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581625.603943:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581625.603961:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b317b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b317b0 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581625.603987:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b317b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b317b0 expref: 17 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581625.603997:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b317b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b317b0 expref: 17 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581625.604021:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6aa00, rc 0) 00000100:00100000:3.0:1788581625.604077:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:22624:x1875463184290944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581625.604083:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788581625.604168:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45153100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184290944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581625.604186:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b317b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b317b7 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581625.604195:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b317b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b317b7 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581625.604294:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184291072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581625.604336:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581625.604365:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d1f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788581625.604393:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184291072 00000100:00100000:3.0:1788581625.604398:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184291072 00000100:00100000:3.0:1788581625.604420:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788581625.604426:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:22624:x1875463184291072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581625.604538:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:22624:x1875463184291072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581625.604545:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788581625.604960:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184291072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581625.605004:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184291200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581625.605058:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581625.605081:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d1f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788581625.605335:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184291200 00000100:00100000:3.0:1788581625.605341:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184291200 00000100:00100000:3.0:1788581625.605379:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788581625.605386:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4580b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:22624:x1875463184291200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581625.605498:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4580b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:22624:x1875463184291200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581625.605506:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788581625.605551:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184291200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788581625.607290:0:23846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788581625.609056:0:22624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788581625.609094:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788581625.609109:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b317b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b317b7 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581625.609122:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b317b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b317b7 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581625.609155:0:22624:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788581625.609158:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e7f798800 from 13 10000000:01000000:0.0:1788581625.609161:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581625.609199:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43272c00/0x50f0cc74b7b317be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581625.609207:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995d43272c00/0x50f0cc74b7b317be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581625.609219:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995d43272c00/0x50f0cc74b7b317be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581625.609244:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184291328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581625.609445:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581625.609876:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81db00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581625.609978:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184291328 00000100:00100000:3.0:1788581625.609986:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184291328 00000100:00100000:3.0:1788581625.610197:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788581625.610208:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+17:22624:x1875463184291328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581625.610236:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581625.610272:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b317c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b317be expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581625.610298:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b317c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b317be expref: 18 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581625.610309:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b317c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b317be expref: 18 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581625.610327:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b200, rc 0) 00000100:00100000:3.0:1788581625.610384:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:22624:x1875463184291328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581625.610390:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788581625.610477:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184291328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581625.610500:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995d43272c00/0x50f0cc74b7b317be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b317c5 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581625.610509:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995d43272c00/0x50f0cc74b7b317be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b317c5 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581625.610580:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184291456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581625.610607:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581625.611312:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d1f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788581625.613998:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184291456 00000100:00100000:0.0:1788581625.614015:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184291456 00000100:00100000:0.0:1788581625.614077:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788581625.614087:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4580a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:22624:x1875463184291456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581625.614250:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4580a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:22624:x1875463184291456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (3641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581625.614273:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788581625.614463:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184291456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581625.614528:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184291584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581625.614597:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581625.614621:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d1f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788581625.614904:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184291584 00000100:00100000:0.0:1788581625.614909:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184291584 00000100:00100000:0.0:1788581625.614930:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788581625.614937:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:22624:x1875463184291584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581625.615137:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:22624:x1875463184291584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581625.615151:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788581625.615242:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184291584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788581625.618219:0:23847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788581625.618861:0:22624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788581625.618884:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788581625.618896:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43272c00/0x50f0cc74b7b317be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b317c5 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581625.618908:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995d43272c00/0x50f0cc74b7b317be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b317c5 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581626.113431:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788581626.690279:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581626.690286:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581626.690298:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581626.690301:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581626.690335:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581626.690349:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581626.690352:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581626.690355:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788581626.690446:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184291712:0@lo:400:kworker.0 00000100:00100000:3.0:1788581626.690470:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184291840:0@lo:400:kworker.0 00000100:00100000:1.0:1788581626.695336:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184292096:0@lo:400:kworker.0 00000100:00100000:3.0:1788581626.703487:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581626.703701:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184291840 00000100:00100000:3.0:1788581626.703710:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184291840 00000100:00100000:2.0:1788581626.703713:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581626.703764:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184292224:0@lo:400:kworker.0 00000100:00100000:3.0:1788581626.703775:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788581626.703783:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184291840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581626.703809:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581626.703835:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581626.703841:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184292352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581626.703866:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581626.703905:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1875463184291840:12345-0@lo:400:kworker.0 Request processed in 122us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581626.703913:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788581626.704060:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184292352 00000100:00100000:3.0:1788581626.704064:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184292352 00000100:00100000:3.0:1788581626.704081:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788581626.704088:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1875463184292352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788581626.704122:0:22631:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788581626.704162:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1875463184292352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581626.704169:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788581626.704208:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184291840:0@lo:400:kworker.0 00000100:00100000:3.0:1788581626.704270:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184292224 00000100:00100000:3.0:1788581626.704274:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184292224 00000100:00100000:3.0:1788581626.705462:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581626.705476:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184292224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581626.705536:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184292224:12345-0@lo:400:kworker.0 Request processed in 65us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581626.705543:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581626.705567:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184291712 00000100:00100000:3.0:1788581626.705573:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184291712 00000100:00100000:3.0:1788581626.705601:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788581626.705608:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4580bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:3620:x1875463184291712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581626.705640:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4580bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:3620:x1875463184291712:12345-0@lo:400:kworker.0 Request processed in 33us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581626.705647:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788581626.706072:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581626.706103:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788581626.706114:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184291968:0@lo:400:kworker.0 00000100:00100000:1.0:1788581626.706146:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581626.706429:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184292480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581626.706455:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581626.706883:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184292096 00000100:00100000:2.0:1788581626.706889:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184292096 00000100:00100000:2.0:1788581626.706915:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184292480 00000100:00100000:2.0:1788581626.706918:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184292480 00000100:00100000:2.0:1788581626.706930:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581626.706937:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3619:x1875463184292096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581626.706992:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3619:x1875463184292096:12345-0@lo:400:kworker.0 Request processed in 55us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581626.706999:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581626.707014:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788581626.707019:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184292480:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581626.707041:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184291968 00000004:00000024:2.0:1788581626.707041:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788581626.707045:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184291968 00000100:00100000:3.0:1788581626.707069:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788581626.707073:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184292480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581626.707075:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184291968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581626.707079:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788581626.707118:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184292352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581626.707150:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184291968:12345-0@lo:400:kworker.0 Request processed in 74us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581626.707157:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788581626.707801:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184291712:0@lo:400:kworker.0 00010000:00080000:2.0:1788581626.707818:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995e766e9c00 x1875463184292224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581626.707830:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184292224:0@lo:400:kworker.0 00000100:00100000:1.0:1788581626.712342:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184292480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581626.712362:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184292096:0@lo:400:kworker.0 00010000:00080000:1.0:1788581626.712404:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995e766e8380 x1875463184291968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581626.712416:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184291968:0@lo:400:kworker.0 00000100:00100000:1.0:1788581626.753473:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581616/real 1788581616] req@ffff995e45153480 x1875463184285824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581626 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581626.753501:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995e45153480 x1875463184285824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581626 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581626.753512:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581616/real 1788581616] req@ffff995e45151180 x1875463184285696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581626 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581626.753521:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995e45151180 x1875463184285696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581626 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788581626.753545:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e6f8e2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788581626.753567:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788581626.753572:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184285824:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788581626.753578:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e72849000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788581626.753583:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788581626.753586:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184285696:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788581626.754075:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581626.754081:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788581626.754083:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581626.754086:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788581626.754089:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581626.754093:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788581626.754096:0:36:0:(import.c:65:import_set_state_nolock()) ffff995e72849000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581626.754101:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 602 00000100:00080000:3.0:1788581626.754106:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788581626.754111:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff995e72849000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581626.754144:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43837100 x1875463184292608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581626.755057:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184292608:0@lo:8:kworker.0 00000400:00000100:1.0:1788581626.755113:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184292608 offset 0 length 520: 4 00000100:00080000:3.0:1788581626.755183:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581626.755187:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788581626.755190:0:36:0:(import.c:65:import_set_state_nolock()) ffff995e6f8e2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581626.755194:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 602 00000100:00080000:3.0:1788581626.755197:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788581626.755201:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff995e6f8e2800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581626.755224:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43836d80 x1875463184292736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581626.755589:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184292736:0@lo:8:kworker.0 00000400:00000100:1.0:1788581626.755614:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184292736 offset 0 length 520: 4 00010000:00010000:1.0:1788581627.137386:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788581627.721131:0:23359:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788581627.779222:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581612/real 1788581612] req@ffff995e766ebb80 x1875463184283648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581627 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581627.779267:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995e766ebb80 x1875463184283648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581627 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581627.779278:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581612/real 1788581612] req@ffff995e766eb100 x1875463184283776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581627 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581627.779289:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995e766eb100 x1875463184283776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581627 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788581627.779318:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4eb3a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788581627.779337:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788581627.779341:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184283648:0@lo:8:kworker.0 00000100:00080000:1.0:1788581627.779355:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e48649800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788581627.779362:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788581627.779365:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184283776:0@lo:8:kworker.0 00000100:00080000:1.0:1788581627.779451:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581627.779455:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788581627.779457:0:8:0:(import.c:65:import_set_state_nolock()) ffff995e4eb3a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788581627.779477:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 598 00000100:00080000:1.0:1788581627.779482:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788581627.779488:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff995e4eb3a800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581627.779508:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e766e8380 x1875463184293120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788581627.779522:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581627.779525:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788581627.779526:0:8:0:(import.c:65:import_set_state_nolock()) ffff995e48649800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788581627.779530:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 598 00000100:00080000:1.0:1788581627.779533:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788581627.779537:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff995e48649800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581627.779550:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e766e8000 x1875463184293248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788581627.779577:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581627.779580:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581627.779583:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581627.779587:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788581627.779621:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a361c037-f8ee-420d-b76d-dbdb9328e15d:3619:1875463184292864:0@lo:400:kworker.0 00000100:00100000:1.0:1788581627.779682:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581627.782909:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184293632:0@lo:400:kworker.0 00000100:00100000:1.0:1788581627.782976:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581627.783024:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581627.783033:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184293504:0@lo:400:kworker.0 00000100:00100000:2.0:1788581627.783040:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184292992:0@lo:400:kworker.0 00000100:00100000:1.0:1788581627.783067:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581627.783097:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581627.783106:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184293376:0@lo:400:kworker.0 00000100:00100000:2.0:1788581627.783152:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184292864 00000100:00100000:2.0:1788581627.783159:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184292864 00000100:00100000:2.0:1788581627.783212:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788581627.783221:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:3619:x1875463184292864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581627.783638:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184293632 00000100:00100000:0.0:1788581627.783643:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184293632 00000100:00100000:0.0:1788581627.783678:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581627.783686:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184293632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581627.785177:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581627.785245:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184293120:0@lo:8:kworker.0 00000400:00000100:1.0:1788581627.785287:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184293120 offset 0 length 520: 4 00000100:00100000:1.0:1788581627.785320:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184293248:0@lo:8:kworker.0 00000400:00000100:1.0:1788581627.785343:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463184293248 offset 0 length 520: 4 00000100:00100000:1.0:1788581627.785368:0:22628:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788581627.785378:0:22628:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788581627.785936:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184293376 00000100:00100000:1.0:1788581627.785943:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184293376 00000100:00100000:1.0:1788581627.785975:0:22628:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788581627.785985:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788581627.785993:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184293376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581627.786051:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184293376:12345-0@lo:400:kworker.0 Request processed in 58us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581627.786058:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788581627.786096:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995e766eb480 x1875463184293376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581627.786126:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184293376:0@lo:400:kworker.0 00000100:00100000:2.0:1788581627.788232:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:3619:x1875463184292864:12345-0@lo:400:kworker.0 Request processed in 5004us (8541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581627.788246:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788581627.791742:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a361c037-f8ee-420d-b76d-dbdb9328e15d:3619:1875463184292864:0@lo:400:kworker.0 00000100:00100000:0.0:1788581627.792110:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184293632:12345-0@lo:400:kworker.0 Request processed in 8422us (9130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581627.792121:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788581627.792213:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995e766e9180 x1875463184293632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581627.792226:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184293632:0@lo:400:kworker.0 00000100:00100000:3.0:1788581627.792901:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184293504 00000100:00100000:3.0:1788581627.792911:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184293504 00000100:00100000:3.0:1788581627.792965:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184292992 00000100:00100000:3.0:1788581627.792969:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184292992 00000100:00100000:3.0:1788581627.792985:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788581627.793001:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184293504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581627.793084:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184293504:12345-0@lo:400:kworker.0 Request processed in 84us (10017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581627.793091:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788581627.793105:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788581627.793112:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184292992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581627.793156:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184292992:12345-0@lo:400:kworker.0 Request processed in 44us (10071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581627.793162:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788581627.793193:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184293504:0@lo:400:kworker.0 00000100:00100000:2.0:1788581627.794678:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184292992:0@lo:400:kworker.0 00010000:00010000:2.0:1788581628.168039:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788581628.738599:0:23380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788581629.185549:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581630.209506:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788581630.724368:0:24127:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788581630.724372:0:24127:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788581630.724373:0:24127:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788581630.724488:0:24127:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff995e6fad9800 00000020:01000004:3.0:1788581630.724505:0:24127:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788581630.724519:0:24127:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788581630.724534:0:24127:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff995e7fa019b8) 00000020:00000080:3.0:1788581630.724554:0:24127:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788581630.794204:0:24127:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788581630.795581:0:24127:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788581630.796078:0:24127:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788581630.796416:0:24127:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788581630.796638:0:24127:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788581630.796931:0:24127:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788581630.797129:0:24127:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788581630.802618:0:24127:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788581630.803060:0:24127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788581630.803081:0:24127:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788581630.803093:0:24127:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x50f0cc74b7b317d3 00000020:01000004:3.0:1788581630.803099:0:24127:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788581630.803119:0:24127:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788581630.803122:0:24127:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788581630.803128:0:24127:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788581630.803134:0:24127:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788581630.803144:0:24127:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff995e7fa04d28) 00000020:00000080:3.0:1788581630.803159:0:24127:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788581630.806602:0:24127:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788581630.808540:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788581630.808548:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788581630.812762:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788581630.812776:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788581630.814651:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788581630.814661:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788581630.816031:0:24127:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581630.816212:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788581630.816218:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788581630.817457:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788581630.817468:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788581630.844226:0:24127:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581630.844895:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788581630.844903:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788581630.846606:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788581630.846697:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788581630.849846:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788581630.849864:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788581630.859198:0:24127:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581630.859439:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788581630.859446:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788581630.860108:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788581630.860117:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788581630.910304:0:24127:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581630.910519:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788581630.910525:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788581630.925410:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788581630.925431:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788581630.927013:0:24127:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788581630.927042:0:24127:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788581630.927049:0:24127:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788581630.956816:0:24127:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788581630.956856:0:24127:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.103@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788581630.956860:0:24127:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788581630.956862:0:24127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788581630.956863:0:24127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581630.956865:0:24127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581630.956866:0:24127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581630.956867:0:24127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581630.956869:0:24127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788581630.956870:0:24127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581630.956876:0:24127:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788581630.956880:0:24127:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788581630.956882:0:24127:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788581630.956883:0:24127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788581630.956884:0:24127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581630.956885:0:24127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581630.956886:0:24127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581630.956887:0:24127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581630.956888:0:24127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788581630.956888:0:24127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581630.956889:0:24127:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788581630.956925:0:24127:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788581630.956946:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45150000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184293760:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788581630.957013:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581630.960419:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e81db0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788581630.961502:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184293760 00000100:00100000:3.0:1788581630.961514:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184293760 00000100:00100000:2.0:1788581630.962079:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788581630.962090:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:24127:x1875463184293760:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788581630.962133:0:22620:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788581630.962136:0:22620:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788581630.962140:0:22620:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788581630.962524:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:24127:x1875463184293760:12345-0@lo:253:mount.lustre.0 Request processed in 435us (5510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581630.962533:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788581630.962651:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45150000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184293760:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788581630.962667:0:24127:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788581630.962671:0:24127:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788581630.962673:0:24127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788581630.962686:0:24127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581630.962688:0:24127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581630.962689:0:24127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581630.962691:0:24127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581630.962692:0:24127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581630.962694:0:24127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581630.962695:0:24127:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788581630.962725:0:24127:0:(tgt_mount.c:101:server_register_mount()) register mount ffff995e6fad9800 from lustre-OST0000 10000000:01000000:1.0:1788581630.962755:0:24127:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788581630.962758:0:24127:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788581630.962775:0:24127:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff995e47874d28 local copy 00010000:00010000:1.0:1788581630.962786:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b3158e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31595 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581630.962905:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f616d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184293888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581630.962947:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581630.962976:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581630.964594:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184293888 00000100:00100000:3.0:1788581630.964606:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184293888 00000100:00100000:3.0:1788581630.964664:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788581630.964677:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:24127:x1875463184293888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581630.964909:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:24127:x1875463184293888:12345-0@lo:501:mount.lustre.0 Request processed in 234us (1959us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788581630.964917:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788581630.965177:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f616d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184293888:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788581630.965214:0:24127:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788581630.965243:0:24127:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788581630.965489:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b3158e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31595 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581630.965501:0:24127:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b3158e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31595 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581630.965532:0:24127:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff995e6fad9800 10000000:01000000:2.0:1788581630.965538:0:24127:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788581630.965544:0:24127:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788581630.965547:0:24127:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788581630.965551:0:24127:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788581630.965554:0:24127:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788581630.965583:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b317e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581630.965592:0:24127:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b317e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581630.965601:0:24127:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b317e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581630.965620:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184294016:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788581630.965659:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581630.965740:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c38cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581630.965785:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184294016 00000100:00100000:1.0:1788581630.965791:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184294016 00000100:00100000:1.0:1788581630.965859:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788581630.965868:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+18:24127:x1875463184294016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581630.965887:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581630.965901:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42ccaa00/0x50f0cc74b7b317e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b317e1 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581630.965921:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42ccaa00/0x50f0cc74b7b317e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b317e1 expref: 19 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581630.965931:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42ccaa00/0x50f0cc74b7b317e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b317e1 expref: 19 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581630.965940:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42ccaa00, rc 0) 00000100:00100000:1.0:1788581630.965990:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+19:24127:x1875463184294016:12345-0@lo:101:mount.lustre.0 Request processed in 124us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581630.965998:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788581630.966101:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184294016:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581630.966113:0:24127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b317e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b317e8 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581630.966129:0:24127:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b317e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b317e8 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788581630.967690:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1788581630.969403:0:24127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788581630.974402:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788581630.974463:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788581630.974480:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788581630.974492:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788581630.974510:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788581630.974525:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788581630.974537:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788581630.974568:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788581630.974583:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788581630.974596:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788581630.974609:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788581630.974623:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788581630.974648:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788581630.974654:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788581630.974772:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184294144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581630.974841:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581630.974893:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c38180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581630.974994:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184294144 00000100:00100000:0.0:1788581630.975002:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184294144 00000100:00100000:0.0:1788581630.975063:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788581630.975073:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+19:24127:x1875463184294144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581630.975221:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+19:24127:x1875463184294144:12345-0@lo:501:mount.lustre.0 Request processed in 149us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581630.975229:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788581630.976169:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184294144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581630.976509:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184294272:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581630.976567:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581630.976684:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c38180 going to sleep for 11 seconds 00000100:00100000:1.0:1788581630.977153:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184294272 00000100:00100000:1.0:1788581630.977160:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184294272 00000100:00100000:1.0:1788581630.977409:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788581630.977420:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+19:24127:x1875463184294272:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581630.981155:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+19:24127:x1875463184294272:12345-0@lo:503:mount.lustre.0 Request processed in 3728us (4577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581630.981172:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788581630.981582:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184294272:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788581630.982032:0:24127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788581630.982113:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184294400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581630.982172:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581630.982950:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c38cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581630.983134:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184294400 00000100:00100000:1.0:1788581630.983142:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184294400 00000100:00100000:1.0:1788581630.983313:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788581630.983325:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+19:24127:x1875463184294400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581630.983924:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+19:24127:x1875463184294400:12345-0@lo:502:mount.lustre.0 Request processed in 599us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581630.983933:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788581630.984022:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184294400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788581630.984246:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788581630.984309:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788581630.984327:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788581630.984342:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788581630.984356:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788581630.984369:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788581630.984382:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788581630.984395:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788581630.984427:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1788581630.984444:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1788581630.984457:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1788581630.984471:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1788581630.984503:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184294528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581630.984549:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581630.985051:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47c38cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581630.985139:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184294528 00000100:00100000:0.0:1788581630.985147:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184294528 00000100:00100000:2.0:1788581630.985246:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788581630.985294:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+19:24127:x1875463184294528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581630.985417:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+19:24127:x1875463184294528:12345-0@lo:502:mount.lustre.0 Request processed in 163us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581630.985424:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788581630.985511:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184294528:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581630.985571:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1788581630.985582:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788581630.986472:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788581630.986481:0:24144:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788581630.986488:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581630.986490:0:24144:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788581630.986496:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788581630.986515:0:24144:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff995e4e370000) 00000020:00000080:0.0:1788581630.986539:0:24144:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788581630.986549:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788581630.986637:0:24144:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e6fad9800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788581630.986646:0:24144:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788581630.986654:0:24144:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x50f0cc74b7b317f6 00010000:00010000:2.0:1788581630.993097:0:24144:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788581630.994481:0:24144:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1788581630.996197:0:24144:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1788581631.000514:0:24144:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788581631.000530:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581631.000541:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581631.000543:0:24144:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788581631.000548:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788581631.000550:0:24144:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788581631.000552:0:24144:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788581631.000553:0:24144:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788581631.000555:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788581631.000558:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581631.000559:0:24144:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788581631.000562:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581631.000565:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581631.000567:0:24144:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788581631.000570:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788581631.000573:0:24144:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788581631.000575:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581631.000577:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581631.000578:0:24144:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788581631.000581:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581631.000583:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581631.000585:0:24144:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788581631.000588:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788581631.000618:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581631.000621:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581631.000623:0:24144:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788581631.000626:0:24144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1788581631.000901:0:24127:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788581631.000936:0:24127:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788581631.000959:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b317e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b317e8 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.000970:0:24127:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42b0f000/0x50f0cc74b7b317e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b317e8 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581631.000979:0:24127:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e6fad9800 from 1 10000000:01000000:1.0:1788581631.000981:0:24127:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788581631.001018:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42ccac00/0x50f0cc74b7b317fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.001038:0:24127:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42ccac00/0x50f0cc74b7b317fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.001048:0:24127:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42ccac00/0x50f0cc74b7b317fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581631.001072:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184294656:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788581631.001138:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.001167:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581631.001315:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184294656 00000100:00100000:2.0:1788581631.001323:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184294656 00000100:00100000:2.0:1788581631.001358:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788581631.001367:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+19:24127:x1875463184294656:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581631.001379:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581631.001399:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0e400/0x50f0cc74b7b31804 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b317fd expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581631.001419:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0e400/0x50f0cc74b7b31804 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b317fd expref: 20 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581631.001428:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0e400/0x50f0cc74b7b31804 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b317fd expref: 20 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581631.001437:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e400, rc 0) 00000100:00100000:2.0:1788581631.001475:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+20:24127:x1875463184294656:12345-0@lo:101:mount.lustre.0 Request processed in 108us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581631.001482:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788581631.001570:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184294656:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581631.001584:0:24127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42ccac00/0x50f0cc74b7b317fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31804 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.001592:0:24127:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42ccac00/0x50f0cc74b7b317fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31804 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581631.002826:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788581631.003084:0:24127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581631.003328:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788581631.003355:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788581631.003369:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788581631.003382:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788581631.003410:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788581631.003427:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788581631.003440:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788581631.003452:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788581631.003465:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788581631.003477:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788581631.003504:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788581631.003523:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788581631.003528:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788581631.004624:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184294784:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581631.004691:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.004773:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581631.006866:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184294784 00000100:00100000:2.0:1788581631.006878:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184294784 00000100:00100000:2.0:1788581631.006936:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788581631.006946:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+20:24127:x1875463184294784:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581631.007100:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+20:24127:x1875463184294784:12345-0@lo:501:mount.lustre.0 Request processed in 155us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581631.007107:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788581631.008915:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184294784:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581631.008973:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184294912:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581631.009038:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.009082:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581631.009147:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184294912 00000100:00100000:3.0:1788581631.009153:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184294912 00000100:00100000:3.0:1788581631.009198:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788581631.009208:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+20:24127:x1875463184294912:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788581631.009339:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+20:24127:x1875463184294912:12345-0@lo:503:mount.lustre.0 Request processed in 132us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581631.009352:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788581631.009438:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184294912:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788581631.009898:0:24127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581631.009964:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184295040:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581631.010004:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.010036:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d42214e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581631.010229:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184295040 00000100:00100000:3.0:1788581631.010235:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184295040 00000100:00100000:3.0:1788581631.010296:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788581631.010305:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+20:24127:x1875463184295040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581631.010394:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+20:24127:x1875463184295040:12345-0@lo:502:mount.lustre.0 Request processed in 90us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581631.010401:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788581631.010483:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184295040:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581631.010673:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788581631.010702:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788581631.011106:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788581631.011125:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788581631.011139:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788581631.011153:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788581631.011166:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788581631.011178:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1788581631.011191:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788581631.011202:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1788581631.011214:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1788581631.011245:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184295168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581631.011325:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581631.011347:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f996600 going to sleep for 11 seconds 00000100:00100000:1.0:1788581631.011458:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184295168 00000100:00100000:1.0:1788581631.011465:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184295168 00000100:00100000:1.0:1788581631.011498:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788581631.011506:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+20:24127:x1875463184295168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581631.011600:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+20:24127:x1875463184295168:12345-0@lo:502:mount.lustre.0 Request processed in 94us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581631.011607:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788581631.012903:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184295168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581631.012986:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1788581631.012999:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788581631.016809:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581631.016824:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581631.016827:0:24148:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788581631.016835:0:24148:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e6fad9800 00000020:00000080:0.0:1788581631.016838:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788581631.016849:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581631.016862:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581631.016864:0:24148:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788581631.016867:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581631.016870:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581631.016871:0:24148:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788581631.016875:0:24148:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e6fad9800 00000020:00000080:0.0:1788581631.016877:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788581631.016966:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581631.016971:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581631.016972:0:24148:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788581631.016974:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581631.016977:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581631.016978:0:24148:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788581631.016981:0:24148:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e6fad9800 00000020:00000080:0.0:1788581631.016983:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788581631.018165:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581631.021370:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581631.021379:0:24148:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788581631.021392:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581631.021399:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581631.021400:0:24148:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788581631.021405:0:24148:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e6fad9800 00000020:00000080:0.0:1788581631.021407:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788581631.021481:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581631.021485:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581631.021486:0:24148:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788581631.021490:0:24148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1788581631.023570:0:24127:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788581631.023614:0:24127:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581631.023634:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42ccac00/0x50f0cc74b7b317fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31804 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.023664:0:24127:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42ccac00/0x50f0cc74b7b317fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31804 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581631.023734:0:24127:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788581631.023737:0:24127:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff995e6fad9800 10000000:01000000:1.0:1788581631.023741:0:24127:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff995e6fad9800 10000000:01000000:1.0:1788581631.023745:0:24127:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788581631.023750:0:24127:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e6fad9800 from 1 10000000:01000000:1.0:1788581631.023753:0:24127:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788581631.023789:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42ccb400/0x50f0cc74b7b3180b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.023796:0:24127:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42ccb400/0x50f0cc74b7b3180b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.023807:0:24127:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42ccb400/0x50f0cc74b7b3180b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581631.023833:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184295296:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788581631.023897:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.023938:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184295296 00000100:00100000:1.0:1788581631.023945:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184295296 00000100:00100000:1.0:1788581631.023985:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788581631.023993:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+20:24127:x1875463184295296:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581631.024005:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581631.024016:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42cca000/0x50f0cc74b7b31812 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b3180b expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.024048:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42cca000/0x50f0cc74b7b31812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b3180b expref: 21 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.024057:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42cca000/0x50f0cc74b7b31812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b3180b expref: 21 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.024065:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42cca000, rc 0) 00000100:00100000:1.0:1788581631.024101:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:24127:x1875463184295296:12345-0@lo:101:mount.lustre.0 Request processed in 109us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581631.024108:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788581631.024151:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46a22f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581631.024173:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184295296:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581631.024186:0:24127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42ccb400/0x50f0cc74b7b3180b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31812 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.024194:0:24127:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42ccb400/0x50f0cc74b7b3180b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31812 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581631.026609:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1788581631.027533:0:24127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581631.028015:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788581631.028043:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788581631.028059:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788581631.028073:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788581631.028085:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788581631.028099:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788581631.028112:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788581631.028124:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788581631.028147:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788581631.028159:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788581631.028188:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788581631.028203:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788581631.028430:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788581631.028448:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788581631.028462:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788581631.028475:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788581631.028487:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788581631.028501:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788581631.028515:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788581631.028528:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788581631.028540:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788581631.028553:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788581631.028569:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788581631.028581:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788581631.028594:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1788581631.028607:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1788581631.028634:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1788581631.028650:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1788581631.028664:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1788581631.028676:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1788581631.028688:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1788581631.028701:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1788581631.028729:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1788581631.028745:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1788581631.028758:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1788581631.028772:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1788581631.028785:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1788581631.028799:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1788581631.028812:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1788581631.028825:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1788581631.028837:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1788581631.028859:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1788581631.028884:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1788581631.028900:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1788581631.028912:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1788581631.028925:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1788581631.028939:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1788581631.028951:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1788581631.029089:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1788581631.029111:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1788581631.029128:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1788581631.029133:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1788581631.029239:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184295424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581631.029338:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.029382:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e525ceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581631.029639:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184295424 00000100:00100000:0.0:1788581631.029646:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184295424 00000100:00100000:0.0:1788581631.029695:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788581631.029705:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:24127:x1875463184295424:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581631.029836:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:24127:x1875463184295424:12345-0@lo:501:mount.lustre.0 Request processed in 132us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581631.029849:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788581631.029976:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184295424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581631.030010:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184295552:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581631.030047:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.030070:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e525ceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581631.030112:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184295552 00000100:00100000:0.0:1788581631.030117:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184295552 00000100:00100000:0.0:1788581631.030148:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788581631.030155:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:24127:x1875463184295552:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788581631.030238:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:24127:x1875463184295552:12345-0@lo:503:mount.lustre.0 Request processed in 82us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581631.030244:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788581631.030399:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184295552:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788581631.030816:0:24127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581631.030878:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184295680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581631.030916:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.030943:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184295680 00000100:00100000:1.0:1788581631.030947:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184295680 00000100:00100000:1.0:1788581631.030974:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788581631.030981:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:24127:x1875463184295680:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581631.031054:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:24127:x1875463184295680:12345-0@lo:502:mount.lustre.0 Request processed in 73us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581631.031067:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788581631.031107:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788581631.031120:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184295680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581631.031417:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788581631.031442:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788581631.031455:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788581631.031470:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788581631.031497:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788581631.031512:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788581631.031523:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788581631.031535:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788581631.031548:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788581631.031559:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788581631.031572:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788581631.031584:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788581631.031596:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788581631.031609:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788581631.031622:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788581631.031634:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788581631.031645:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788581631.031656:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788581631.031669:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788581631.031683:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788581631.031922:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788581631.031944:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788581631.031957:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788581631.031970:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788581631.031982:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788581631.031995:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788581631.032007:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788581631.032031:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788581631.032044:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788581631.032053:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788581631.032063:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788581631.032074:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788581631.032087:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788581631.032101:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788581631.032113:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788581631.032126:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788581631.032149:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788581631.032164:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788581631.032177:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788581631.032189:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788581631.032203:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788581631.032417:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788581631.032436:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788581631.032450:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788581631.032464:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788581631.032477:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788581631.032491:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1788581631.032504:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1788581631.032546:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184295808:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581631.032601:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.032635:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184295808 00000100:00100000:1.0:1788581631.032641:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184295808 00000100:00100000:1.0:1788581631.032673:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788581631.032680:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:24127:x1875463184295808:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581631.032840:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:24127:x1875463184295808:12345-0@lo:502:mount.lustre.0 Request processed in 160us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581631.032848:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788581631.032896:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788581631.032913:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184295808:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581631.033040:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1788581631.033061:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1788581631.033082:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184295936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581631.033112:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.033135:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184295936 00000100:00100000:1.0:1788581631.033138:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184295936 00000100:00100000:1.0:1788581631.033170:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788581631.033176:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:24127:x1875463184295936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581631.033243:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:24127:x1875463184295936:12345-0@lo:502:mount.lustre.0 Request processed in 67us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581631.033250:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788581631.033313:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478c0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788581631.033326:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184295936:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581631.033359:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788581631.033366:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788581631.034430:0:24152:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788581631.034447:0:24152:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff995e47873370) 00000020:00000080:1.0:1788581631.034468:0:24152:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788581631.034543:0:24152:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e6fad9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788581631.034547:0:24152:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e6fad9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788581631.034550:0:24152:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e6fad9800 3 00010000:00080000:1.0:1788581631.034576:0:24152:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995d4328f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1788581631.040319:0:24152:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788581631.040552:0:24152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788581631.040593:0:24152:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788581631.040610:0:24152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x50f0cc74b7b31820 00000100:00080000:1.0:1788581631.040620:0:24152:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788581631.040625:0:24152:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff995d4328f000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581631.040659:0:24152:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e7f615c00 x1875463184296064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581631.040698:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875463184296064:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788581631.040763:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.040820:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184296064 00000100:00100000:1.0:1788581631.040827:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184296064 00000100:00100000:1.0:1788581631.040855:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581631.040862:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875463184296064:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788581631.040882:0:22628:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 617 last 0 00000020:00000080:1.0:1788581631.040915:0:22628:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x50f0cc74b7b31827 00000004:00100000:1.0:1788581631.040929:0:22628:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788581631.040957:0:22628:0:(import.c:65:import_set_state_nolock()) ffff995d4328f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581631.041004:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875463184296064:12345-0@lo:38:llog_process_th.0 Request processed in 141us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581631.041013:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788581631.041050:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995e7f615c00 x1875463184296064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581631.041060:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788581631.041067:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788581631.041074:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788581631.041077:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788581631.041079:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d4328f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788581631.041084:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875463184296064:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788581631.041108:0:24152:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788581631.042072:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581631.042078:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581631.042081:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581631.042083:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788581631.042085:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184296192:0@lo:400:kworker.0 00000100:00080000:1.0:1788581631.042112:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581631.042115:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581631.042118:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581631.042121:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788581631.042128:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.042147:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184296320:0@lo:400:kworker.0 00000100:00100000:1.0:1788581631.042173:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.042200:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184296448:0@lo:400:kworker.0 00000100:00100000:1.0:1788581631.042223:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.042242:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581631.042246:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184296576:0@lo:400:kworker.0 00000100:00100000:1.0:1788581631.042498:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.042541:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184296320 00000100:00100000:1.0:1788581631.042548:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184296320 00000100:00100000:1.0:1788581631.042584:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184296576 00000100:00100000:1.0:1788581631.042588:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184296576 00000100:00100000:1.0:1788581631.042612:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581631.042620:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184296320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581631.042662:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184296320:12345-0@lo:400:kworker.0 Request processed in 43us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581631.042679:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581631.042694:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581631.042699:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184296576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581631.042802:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184296576:12345-0@lo:400:kworker.0 Request processed in 100us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581631.042872:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581631.042895:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184296192 00000100:00100000:1.0:1788581631.042899:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184296192 00000100:00100000:1.0:1788581631.042921:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184296448 00000100:00100000:1.0:1788581631.042924:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184296448 00000100:00100000:1.0:1788581631.042936:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788581631.042942:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184296192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581631.042988:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184296192:12345-0@lo:400:kworker.0 Request processed in 46us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581631.042993:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788581631.043007:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184296192:0@lo:400:kworker.0 00000100:00100000:1.0:1788581631.043009:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788581631.043016:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184296448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581631.043045:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184296448:12345-0@lo:400:kworker.0 Request processed in 31us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581631.043051:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788581631.043145:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995e7f614000 x1875463184296320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581631.043157:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184296320:0@lo:400:kworker.0 00010000:00080000:1.0:1788581631.043178:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995e7f615180 x1875463184296576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581631.043196:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184296576:0@lo:400:kworker.0 00000100:00100000:1.0:1788581631.043209:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184296448:0@lo:400:kworker.0 00000020:01000004:1.0:1788581631.049084:0:24152:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788581631.049103:0:24152:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff995d42c04d28) 00000020:00000080:1.0:1788581631.049128:0:24152:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1788581631.049229:0:24152:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e6fad9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788581631.049234:0:24152:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e6fad9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788581631.049236:0:24152:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e6fad9800 3 00010000:00080000:1.0:1788581631.049671:0:24152:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995d4328b000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1788581631.051698:0:24152:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1788581631.054269:0:24152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788581631.054378:0:24152:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788581631.054391:0:24152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x50f0cc74b7b31835 00000100:00080000:1.0:1788581631.054401:0:24152:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788581631.054407:0:24152:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff995d4328b000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581631.054440:0:24152:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e7f617b80 x1875463184296704/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788581631.054469:0:24152:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788581631.054499:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581631.054503:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581631.054506:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581631.054509:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581631.054513:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581631.054515:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581631.054524:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581631.054527:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788581631.054859:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875463184296704:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788581631.054928:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.056508:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184296704 00000100:00100000:1.0:1788581631.056519:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184296704 00000100:00100000:1.0:1788581631.056558:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788581631.056566:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875463184296704:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788581631.056597:0:22627:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 617 last 0 00000020:00000080:1.0:1788581631.056646:0:22627:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x50f0cc74b7b3183c 00000004:00100000:1.0:1788581631.056661:0:22627:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788581631.056693:0:22627:0:(import.c:65:import_set_state_nolock()) ffff995d4328e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581631.057014:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875463184296704:12345-0@lo:38:llog_process_th.0 Request processed in 446us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581631.057021:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1788581631.057121:0:24152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788581631.057227:0:24127:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788581631.057275:0:24127:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788581631.057308:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42ccb400/0x50f0cc74b7b3180b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31812 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.057320:0:24127:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42ccb400/0x50f0cc74b7b3180b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31812 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788581631.057366:0:24127:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788581631.057369:0:24127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788581631.057370:0:24127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581631.057371:0:24127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581631.057373:0:24127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581631.057374:0:24127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581631.057375:0:24127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00010000:00080000:2.0:1788581631.057380:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff995e7f617b80 x1875463184296704/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:01000004:1.0:1788581631.057380:0:24127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581631.057382:0:24127:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788581631.057385:0:24127:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788581631.057387:0:24127:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788581631.057388:0:24127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788581631.057389:0:24127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581631.057391:0:24127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581631.057392:0:24127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581631.057393:0:24127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581631.057394:0:24127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581631.057395:0:24127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581631.057396:0:24127:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788581631.057401:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788581631.057410:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 10000000:01000000:1.0:1788581631.057414:0:24127:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00080000:2.0:1788581631.057416:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788581631.057421:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788581631.057423:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d4328b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788581631.057430:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875463184296704:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788581631.057430:0:24127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184296832:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788581631.057473:0:24127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.057501:0:24127:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a70e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788581631.057801:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184296832 00000100:00100000:1.0:1788581631.057869:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184296832 00000100:00100000:1.0:1788581631.057904:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788581631.057912:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:24127:x1875463184296832:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788581631.057933:0:22620:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788581631.057945:0:22620:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788581631.063873:0:22620:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788581631.063895:0:22620:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788581631.064795:0:22642:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788581631.064802:0:22642:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788581631.064825:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995d43272400/0x50f0cc74b7b31843 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581631.064843:0:22642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b3178d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31786 expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581631.064850:0:22642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b3179b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31794 expref: 21 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581631.064857:0:22642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995d43272400/0x50f0cc74b7b31843 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581631.064898:0:22642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b3179b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b31794 expref: 21 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581631.064913:0:22642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b3179b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b31794 expref: 21 pid: 22622 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581631.064927:0:22642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45152d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875463184296960:0@lo:104: 00000100:00100000:0.0:1788581631.065000:0:22642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788581631.065059:0:22642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b3178d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b31786 expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581631.065067:0:22642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b3178d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b31786 expref: 21 pid: 22621 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581631.065075:0:22642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875463184297088:0@lo:104: 00000100:00100000:0.0:1788581631.065101:0:22642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581631.065124:0:22642:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f996600 going to sleep for 11 seconds 00000100:00100000:1.0:1788581631.065163:0:22610:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788581631.065180:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184296960 00000100:00100000:1.0:1788581631.065186:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184296960 00000100:00100000:1.0:1788581631.065230:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184297088 00000100:00100000:1.0:1788581631.065233:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184297088 00000100:00100000:1.0:1788581631.065248:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581631.065274:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45150000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+4:22642:x1875463184296960:12345-0@lo:104: 00010000:00010000:1.0:1788581631.065297:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b31794 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b3179b expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.065362:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788581631.065368:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45150000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+4:22642:x1875463184296960:12345-0@lo:104: Request processed in 98us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581631.065372:0:22642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45152d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875463184296960:0@lo:104: 00000100:00100000:1.0:1788581631.065376:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581631.065392:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788581631.065399:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45744450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+3:22642:x1875463184297088:12345-0@lo:104: 00010000:00010000:1.0:1788581631.065406:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b3178d expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.065460:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788581631.065463:0:22642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875463184297088:0@lo:104: 00000100:00100000:1.0:1788581631.065465:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45744450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+3:22642:x1875463184297088:12345-0@lo:104: Request processed in 68us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581631.065471:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788581631.065483:0:22642:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995d43272400/0x50f0cc74b7b31843 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.065501:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581631.065506:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b31794 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b3179b expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.065513:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581631.065516:0:22615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b31794 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b3179b expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.065524:0:22615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b31794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b3179b expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581631.065531:0:22615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b31794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b3179b expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581631.065537:0:22615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581631.065576:0:22615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b31794 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b3179b expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.065582:0:22615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581631.065608:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b31794 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b3179b expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.065616:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e49e6b400/0x50f0cc74b7b31794 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b3179b expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.065628:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581631.065631:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b3178d expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.065636:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccbe00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788581631.065638:0:22615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b3178d expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.065644:0:22615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b3178d expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581631.065650:0:22615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b3178d expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581631.065654:0:22615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581631.065666:0:22615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31786 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b3178d expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.065671:0:22615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581631.065676:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31786 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b3178d expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.065692:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31786 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b3178d expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581631.065704:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581631.065705:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581631.065707:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581631.065726:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184297216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581631.065755:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581631.065758:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a361c037-f8ee-420d-b76d-dbdb9328e15d:3621:1875463184297344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581631.065784:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581631.065885:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184297216 00000100:00100000:1.0:1788581631.065890:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184297216 00010000:00010000:1.0:1788581631.065909:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b3179b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b31794 expref: 22 pid: 22622 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581631.065974:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581631.065974:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184297344 00000100:00100000:1.0:1788581631.065979:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184297344 00010000:00010000:1.0:1788581631.065992:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b3178d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b31786 expref: 23 pid: 22621 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581631.066365:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581631.066373:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f615f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:3620:x1875463184297216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581631.066385:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581631.066391:0:22614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b3179b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b31794 expref: 23 pid: 22622 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581631.066402:0:22614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b3179b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b31794 expref: 23 pid: 22622 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581631.066415:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b3179b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b31794 expref: 23 pid: 22622 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581631.066621:0:22613:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788581631.066638:0:22612:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788581631.066646:0:22612:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788581631.066686:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788581631.066694:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b535850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:3621:x1875463184297344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581631.066703:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581631.066707:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b3178d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b31786 expref: 23 pid: 22621 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581631.066717:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b3178d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b31786 expref: 23 pid: 22621 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581631.066727:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b3178d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b31786 expref: 23 pid: 22621 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581631.066739:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995d43272400/0x50f0cc74b7b31843 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581631.066746:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43272400/0x50f0cc74b7b31843 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788581631.066757:0:22613:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.026306895s 00010000:00010000:3.0:1788581631.066769:0:22613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995d43272400/0x50f0cc74b7b31843 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581631.066775:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995d43272400/0x50f0cc74b7b31843 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581631.066781:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995d43272400/0x50f0cc74b7b31843 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581631.066787:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995d43272400/0x50f0cc74b7b31843 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581631.066792:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581631.066796:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995d43272400/0x50f0cc74b7b31843 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581631.066802:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995d43272400/0x50f0cc74b7b31843 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581631.066830:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995d43272400/0x50f0cc74b7b31843 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581631.066840:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581631.066884:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b535850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:3621:x1875463184297344:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581631.066894:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788581631.066941:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a361c037-f8ee-420d-b76d-dbdb9328e15d:3621:1875463184297344:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581631.066974:0:22642:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995d43272400/0x50f0cc74b7b31843 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581631.066982:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995d43272400/0x50f0cc74b7b31843 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581631.066995:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995d43272400/0x50f0cc74b7b31843 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581631.067993:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581631.068056:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f615f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a361c037-f8ee-420d-b76d-dbdb9328e15d+20:3620:x1875463184297216:12345-0@lo:103:ldlm_bl.0 Request processed in 1681us (2297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581631.068064:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788581631.068161:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184297216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581631.068431:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+19:24127:x1875463184296832:12345-0@lo:253:mount.lustre.0 Request processed in 10519us (10956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581631.068441:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788581631.068635:0:24127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24127:1875463184296832:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788581631.068647:0:24127:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788581631.068651:0:24127:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788581631.068652:0:24127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788581631.068654:0:24127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581631.068655:0:24127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581631.068656:0:24127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581631.068657:0:24127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581631.068659:0:24127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581631.068660:0:24127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581631.068668:0:24127:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788581631.068682:0:24127:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1788581631.076684:0:24127:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788581631.079621:0:24127:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788581631.079631:0:24127:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788581631.079669:0:24127:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788581631.079715:0:24127:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788581631.079736:0:24127:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788581631.079763:0:24127:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788581631.080420:0:24127:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788581631.080616:0:24127:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788581631.233397:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581631.810525:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581631.810618:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581631.810637:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184297600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581631.810724:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581631.811090:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184297600 00000100:00100000:2.0:1788581631.811098:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184297600 00000100:00100000:2.0:1788581631.811155:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788581631.811164:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184297600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788581631.811195:0:23367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788581631.811241:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184297600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581631.811247:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788581631.811323:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184297600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788581631.811467:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184297472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581631.811500:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581631.811739:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184297472 00000100:00100000:2.0:1788581631.811744:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184297472 00000100:00100000:2.0:1788581631.811776:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788581631.811797:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184297472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788581631.811817:0:22631:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788581631.811854:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184297472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581631.811860:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788581631.811893:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184297472:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1788581631.967375:0:24208:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788581631.967612:0:24208:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788581632.258500:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788581632.385891:0:22624:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788581632.385899:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e6be35800 from 13 10000000:01000000:1.0:1788581632.385904:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788581632.385952:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b3184a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581632.385963:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b3184a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581632.385974:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b3184a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581632.385999:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f614a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184297728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788581632.386062:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581632.386364:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e512b1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581632.387840:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184297728 00000100:00100000:3.0:1788581632.387851:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184297728 00000100:00100000:2.0:1788581632.390500:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788581632.390521:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+19:22624:x1875463184297728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581632.390538:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581632.390557:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0f200/0x50f0cc74b7b31851 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b3184a expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581632.390585:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0f200/0x50f0cc74b7b31851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b3184a expref: 20 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581632.390596:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0f200/0x50f0cc74b7b31851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b3184a expref: 20 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581632.390605:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f200, rc 0) 00000100:00100000:2.0:1788581632.390692:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+20:22624:x1875463184297728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (4628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581632.390699:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788581632.390784:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f614a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184297728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581632.390801:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b3184a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31851 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581632.390810:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b3184a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31851 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581632.390878:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43834700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184297856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788581632.390915:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581632.393099:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50a5f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788581632.393365:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184297856 00000100:00100000:1.0:1788581632.393374:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184297856 00000100:00100000:1.0:1788581632.393423:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788581632.393432:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+20:22624:x1875463184297856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788581632.393454:0:22621:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788581632.393475:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788581632.393478:0:22621:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788581632.393584:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+20:22624:x1875463184297856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (2668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581632.393591:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788581632.393729:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43834700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184297856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788581632.393799:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788581632.393809:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b3184a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31851 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581632.393828:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b3184a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31851 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581632.393838:0:22624:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788581632.393840:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e7f798800 from 13 10000000:01000000:2.0:1788581632.393843:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788581632.393870:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b31858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581632.393878:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b31858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581632.393887:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b31858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581632.393905:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184297984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788581632.393938:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581632.393959:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4ebde240 going to sleep for 11 seconds 00000100:00100000:1.0:1788581632.394015:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184297984 00000100:00100000:1.0:1788581632.394026:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184297984 00000100:00100000:1.0:1788581632.394059:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788581632.394066:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+20:22624:x1875463184297984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581632.394075:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581632.394087:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b3185f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b31858 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581632.394105:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b3185f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b31858 expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581632.394114:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b3185f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31858 expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581632.394132:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42cca200, rc 0) 00000100:00100000:1.0:1788581632.394160:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:22624:x1875463184297984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581632.394167:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788581632.394345:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184297984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581632.394357:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b31858 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3185f expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581632.394365:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b31858 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b3185f expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581632.394407:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e550af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184298112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788581632.394438:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581632.394462:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4ebde240 going to sleep for 11 seconds 00000100:00100000:1.0:1788581632.394555:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184298112 00000100:00100000:1.0:1788581632.394560:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184298112 00000100:00100000:1.0:1788581632.394589:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788581632.394595:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:22624:x1875463184298112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788581632.394607:0:22621:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788581632.394620:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788581632.394623:0:22621:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788581632.394688:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:22624:x1875463184298112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 93us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581632.394696:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788581632.394761:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e550af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184298112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788581632.394804:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788581632.394810:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b31858 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3185f expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581632.394817:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b31858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3185f expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581633.281601:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581634.309247:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581635.330492:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581635.779622:0:22661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788581636.353513:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788581636.417564:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581636.417582:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581636.417585:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581636.417588:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581636.417612:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581636.417614:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581636.417617:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581636.417619:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788581636.417668:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184298240:0@lo:400:kworker.0 00000100:00100000:1.0:1788581636.417734:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581636.417773:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184298752:0@lo:400:kworker.0 00000100:00100000:1.0:1788581636.417793:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581636.417814:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788581636.417819:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184298368:0@lo:400:kworker.0 00000100:00100000:1.0:1788581636.417838:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581636.417851:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184298880:0@lo:400:kworker.0 00000100:00100000:1.0:1788581636.417866:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581636.417888:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184298496:0@lo:400:kworker.0 00000100:00100000:1.0:1788581636.417905:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581636.417919:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184299008:0@lo:400:kworker.0 00000100:00100000:1.0:1788581636.417937:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581636.417949:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581636.417953:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184298624:0@lo:400:kworker.0 00000100:00100000:1.0:1788581636.417980:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581636.418009:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184298240 00000100:00100000:1.0:1788581636.418015:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184298240 00000100:00100000:1.0:1788581636.418065:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788581636.418073:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:3620:x1875463184298240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581636.418113:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:3620:x1875463184298240:12345-0@lo:400:kworker.0 Request processed in 41us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581636.418120:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788581636.418150:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184298752 00000100:00100000:1.0:1788581636.418153:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184298752 00000100:00100000:1.0:1788581636.418167:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184298880 00000100:00100000:1.0:1788581636.418169:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184298880 00000100:00100000:1.0:1788581636.418194:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184298496 00000100:00100000:1.0:1788581636.418196:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184298496 00000100:00100000:1.0:1788581636.418206:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184299008 00000100:00100000:1.0:1788581636.418208:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184299008 00000100:00100000:1.0:1788581636.418221:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788581636.418227:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184298752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581636.418286:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184298752:12345-0@lo:400:kworker.0 Request processed in 59us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581636.418293:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788581636.418307:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581636.418312:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184298880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581636.418339:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184298880:12345-0@lo:400:kworker.0 Request processed in 27us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581636.418345:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581636.418355:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581636.418360:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184298496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581636.418400:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184298496:12345-0@lo:400:kworker.0 Request processed in 40us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581636.418407:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581636.418419:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581636.418425:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184299008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581636.418449:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184299008:12345-0@lo:400:kworker.0 Request processed in 25us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581636.418454:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581636.418470:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184298368 00000100:00100000:1.0:1788581636.418473:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184298368 00000100:00100000:1.0:1788581636.418494:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184298624 00000100:00100000:1.0:1788581636.418497:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184298624 00000100:00100000:1.0:1788581636.418507:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788581636.418512:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184298368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581636.418540:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184298368:12345-0@lo:400:kworker.0 Request processed in 28us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581636.418546:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788581636.418555:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788581636.418560:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184298624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581636.418584:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184298624:12345-0@lo:400:kworker.0 Request processed in 25us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581636.418589:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788581636.418638:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184298624:0@lo:400:kworker.0 00010000:00080000:1.0:1788581636.418651:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7f616a00 x1875463184298496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581636.418661:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184298496:0@lo:400:kworker.0 00010000:00080000:1.0:1788581636.418681:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7f615f80 x1875463184299008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581636.418690:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184299008:0@lo:400:kworker.0 00000100:00100000:1.0:1788581636.418720:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184298368:0@lo:400:kworker.0 00010000:00080000:1.0:1788581636.418728:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7f614000 x1875463184298880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581636.418736:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184298880:0@lo:400:kworker.0 00000100:00100000:1.0:1788581636.418744:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184298240:0@lo:400:kworker.0 00010000:00080000:1.0:1788581636.418751:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7f615180 x1875463184298752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581636.418758:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184298752:0@lo:400:kworker.0 00000100:00080000:3.0:1788581636.419752:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581636.419759:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581636.929520:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184299136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581636.929590:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581636.929653:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184299136 00000100:00100000:3.0:1788581636.929661:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184299136 00000100:00100000:3.0:1788581636.929708:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788581636.929718:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184299136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788581636.929750:0:22631:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788581636.929792:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184299136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581636.929799:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788581636.929845:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184299136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788581636.929961:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581636.929974:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184299264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788581636.930002:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581636.930045:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184299264 00000100:00100000:0.0:1788581636.930050:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184299264 00000100:00100000:0.0:1788581636.930086:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788581636.930092:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184299264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788581636.930110:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788581636.930142:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184299264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581636.930149:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788581636.930179:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184299264:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788581637.377460:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788581637.734701:0:24498:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788581638.403762:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788581638.845849:0:24550:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788581638.846085:0:24550:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1788581638.977872:0:23380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788581639.441870:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788581639.834006:0:24600:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788581639.834236:0:24600:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788581640.454136:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581641.281444:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581626/real 1788581626] req@ffff995d43836d80 x1875463184292736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581641 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581641.281605:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995d43836d80 x1875463184292736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581641 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581641.281616:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581626/real 1788581626] req@ffff995d43837100 x1875463184292608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581641 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581641.281627:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995d43837100 x1875463184292608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581641 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788581641.281648:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e6f8e2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788581641.281674:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788581641.281679:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184292736:0@lo:8:kworker.0 00000100:00080000:2.0:1788581641.281684:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e72849000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788581641.281691:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788581641.281695:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184292608:0@lo:8:kworker.0 00000100:00080000:1.0:1788581641.281788:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581641.281793:0:15242:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581641.281796:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581641.281798:0:15242:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581641.281815:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581641.281817:0:15242:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788581641.281820:0:15242:0:(import.c:65:import_set_state_nolock()) ffff995e72849000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788581641.281825:0:15242:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 612 00000100:00080000:1.0:1788581641.281848:0:15242:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788581641.281855:0:15242:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff995e72849000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581641.281876:0:15242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e766e9c00 x1875463184299904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788581641.281892:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581641.281895:0:15242:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788581641.281896:0:15242:0:(import.c:65:import_set_state_nolock()) ffff995e6f8e2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788581641.281899:0:15242:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 612 00000100:00080000:1.0:1788581641.281902:0:15242:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788581641.281905:0:15242:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff995e6f8e2800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581641.281916:0:15242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e766e9180 x1875463184300032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581641.281959:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184299776:0@lo:400:kworker.0 00000100:00100000:1.0:1788581641.282020:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581641.282066:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788581641.282071:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184299392:0@lo:400:kworker.0 00000100:00100000:1.0:1788581641.282097:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581641.282121:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184300160:0@lo:400:kworker.0 00000100:00100000:2.0:1788581641.282128:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184299520:0@lo:400:kworker.0 00000100:00100000:1.0:1788581641.282145:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581641.282171:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581641.282175:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184299648:0@lo:400:kworker.0 00000100:00100000:2.0:1788581641.282201:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184300288:0@lo:400:kworker.0 00000100:00100000:1.0:1788581641.282208:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581641.282245:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184300416:0@lo:400:kworker.0 00000100:00100000:2.0:1788581641.282251:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581641.282296:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581641.282336:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184299776 00000100:00100000:1.0:1788581641.282347:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184299776 00000100:00100000:1.0:1788581641.282391:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184299520 00000100:00100000:1.0:1788581641.282393:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184299520 00000100:00100000:1.0:1788581641.282407:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788581641.282414:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184299776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581641.282471:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184299776:12345-0@lo:400:kworker.0 Request processed in 46us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581641.282478:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788581641.282492:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788581641.282497:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184299520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581641.282702:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184299520:12345-0@lo:400:kworker.0 Request processed in 203us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581641.282710:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788581641.282721:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184300160 00000100:00100000:2.0:1788581641.282728:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184300160 00000100:00100000:1.0:1788581641.282733:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184299648 00000100:00100000:1.0:1788581641.282738:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184299648 00000100:00100000:2.0:1788581641.282767:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184300288 00000100:00100000:1.0:1788581641.282768:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184300416 00000100:00100000:2.0:1788581641.282772:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184300288 00000100:00100000:1.0:1788581641.282774:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184300416 00000100:00100000:2.0:1788581641.282854:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788581641.282862:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184300160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581641.282899:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875463184300160:12345-0@lo:400:kworker.0 Request processed in 39us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581641.282905:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788581641.282918:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788581641.282925:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184299648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581641.282970:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184299648:12345-0@lo:400:kworker.0 Request processed in 46us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581641.282977:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788581641.282989:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581641.283004:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184300288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581641.283243:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184300288:12345-0@lo:400:kworker.0 Request processed in 248us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581641.283250:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581641.283288:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184299392 00000100:00100000:2.0:1788581641.283292:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184299392 00000100:00100000:2.0:1788581641.283318:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788581641.283333:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:3620:x1875463184299392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581641.283364:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:3620:x1875463184299392:12345-0@lo:400:kworker.0 Request processed in 32us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581641.283370:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788581641.283431:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184299520:0@lo:400:kworker.0 00010000:00080000:2.0:1788581641.283445:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e766eb480 x1875463184300288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581641.283453:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184300288:0@lo:400:kworker.0 00000100:00100000:2.0:1788581641.283494:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184299904:0@lo:8:kworker.0 00000100:00100000:2.0:1788581641.283529:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581641.283558:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184300032:0@lo:8:kworker.0 00000100:00100000:2.0:1788581641.283583:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581641.283619:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184299904 00000100:00100000:2.0:1788581641.283623:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184299904 00000100:00100000:2.0:1788581641.283648:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184300032 00000100:00100000:2.0:1788581641.283651:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184300032 00000100:00100000:2.0:1788581641.283663:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581641.283669:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1875463184299904:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788581641.283674:0:24134:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788581641.283684:0:24134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:2.0:1788581641.283695:0:24133:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:2.0:1788581641.283728:0:24133:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b31866 00002000:00100000:2.0:1788581641.283912:0:24133:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff995e4864e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788581641.283918:0:24133:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788581641.283921:0:24133:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788581641.283937:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788581641.283946:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184300416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581641.283988:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875463184300416:12345-0@lo:400:kworker.0 Request processed in 44us (1692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581641.283995:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788581641.284142:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e766e9500 x1875463184299648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581641.284153:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184299648:0@lo:400:kworker.0 00010000:00080000:1.0:1788581641.284166:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7f615180 x1875463184300416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581641.284188:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875463184300416:0@lo:400:kworker.0 00000100:00100000:1.0:1788581641.284235:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184299392:0@lo:400:kworker.0 00010000:00080000:1.0:1788581641.284249:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e766eb100 x1875463184300160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581641.284275:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875463184300160:0@lo:400:kworker.0 00000100:00100000:1.0:1788581641.284290:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184299776:0@lo:400:kworker.0 00002000:00080000:2.0:1788581641.284304:0:24133:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788581641.284332:0:24133:0:(import.c:65:import_set_state_nolock()) ffff995e4864f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581641.284389:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1875463184299904:12345-0@lo:8:kworker.0 Request processed in 719us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581641.284396:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581641.284410:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581641.284416:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1875463184300032:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788581641.284429:0:24133:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788581641.284469:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e766e9c00 x1875463184299904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581641.284478:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788581641.284485:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788581641.284492:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788581641.284496:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788581641.284499:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e72849000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788581641.284511:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788581641.286660:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184299904:0@lo:8:kworker.0 00000100:00080000:0.0:1788581641.286722:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581641.286738:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788581641.286744:0:23369:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788581641.286750:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581641.286769:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184300544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581641.286771:0:23369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f616a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23369:1875463184300672:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788581641.287114:0:23369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581641.292537:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581641.292658:0:23369:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4ebded80 going to sleep for 11 seconds 00000004:00080000:1.0:1788581641.292681:0:23368:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788581641.292782:0:23368:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 627434526939ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788581641.292789:0:23368:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788581641.292920:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184300672 00000100:00100000:1.0:1788581641.292941:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184300672 00000100:00100000:1.0:1788581641.292998:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581641.293008:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23369:x1875463184300672:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788581641.293293:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184300544 00000100:00100000:1.0:1788581641.293298:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184300544 00000100:00100000:1.0:1788581641.293330:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581641.293338:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3621:x1875463184300544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788581641.293371:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788581641.293439:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3621:x1875463184300544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581641.293446:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788581641.293883:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7f615180 x1875463184300544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581641.293904:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184300544:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788581641.293931:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788581641.298605:0:23359:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788581641.306336:0:24134:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788581641.306348:0:24134:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788581641.306448:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23369:x1875463184300672:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13436us (19330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581641.306461:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788581641.306471:0:23369:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7f616a00 x1875463184300672/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788581657 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581641.306490:0:23369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f616a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23369:1875463184300672:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788581641.306507:0:23369:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788581641.306549:0:23369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23369:1875463184300800:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788581641.306586:0:23369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581641.306616:0:23369:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e53b6a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581641.307948:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184300800 00000100:00100000:1.0:1788581641.307959:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184300800 00000100:00100000:1.0:1788581641.308019:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581641.308030:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23369:x1875463184300800:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788581641.308062:0:24131:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788581641.308121:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23369:x1875463184300800:12345-0@lo:5:osp-pre-0-1.0 Request processed in 92us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581641.308127:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788581641.308209:0:23369:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e45151c00 x1875463184300800/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581657 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581641.308234:0:23369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23369:1875463184300800:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788581641.308247:0:23369:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788581641.308304:0:23369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23369:1875463184300928:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788581641.308335:0:23369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581641.308357:0:23369:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e53b6a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581641.308375:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184300928 00000100:00100000:0.0:1788581641.308386:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184300928 00000100:00100000:0.0:1788581641.308410:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788581641.308416:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23369:x1875463184300928:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788581641.308442:0:24665:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1788581641.314901:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1875463184300032:12345-0@lo:8:kworker.0 Request processed in 30476us (31308us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788581641.314915:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788581641.315361:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e6f8e2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788581641.315368:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788581641.315372:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184300032:0@lo:8:kworker.0 00000001:00080000:0.0:1788581641.349041:0:24128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1788581641.349058:0:24128:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788581641.349337:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23369:x1875463184300928:12345-0@lo:5:osp-pre-0-1.0 Request processed in 40916us (40996us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788581641.349349:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788581641.352479:0:23369:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e45151c00 x1875463184300928/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581657 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581641.352494:0:23369:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788581641.352501:0:23369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23369:1875463184300928:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788581641.352518:0:23369:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1788581641.352571:0:23369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23369:1875463184301056:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788581641.353481:0:23369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581641.353564:0:23369:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e53b6a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581641.356115:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184301056 00000100:00100000:1.0:1788581641.356136:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184301056 00000100:00100000:1.0:1788581641.356203:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581641.356229:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23369:x1875463184301056:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788581641.356556:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23369:x1875463184301056:12345-0@lo:900:osp-pre-0-1.0 Request processed in 343us (3076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581641.356564:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788581641.356668:0:23369:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e45151c00 x1875463184301056/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788581657 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581641.356684:0:23369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23369:1875463184301056:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1788581641.483693:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581642.049948:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581642.049972:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184301184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581642.050041:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581642.050144:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184301184 00000100:00100000:3.0:1788581642.050151:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184301184 00000100:00100000:3.0:1788581642.050193:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788581642.050203:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184301184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581642.050245:0:22631:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788581642.050316:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184301184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581642.050335:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788581642.050419:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184301312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788581642.050449:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581642.050481:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184301312 00000100:00100000:0.0:1788581642.050486:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184301312 00000100:00100000:0.0:1788581642.050518:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788581642.050524:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184301312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788581642.050542:0:23367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788581642.050578:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184301312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581642.050584:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788581642.051207:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184301312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581642.051334:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184301184:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788581642.500488:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581643.524766:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581644.546530:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581645.570020:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581646.019018:0:22661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788581646.594959:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581646.658178:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184301440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581646.658310:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1788581646.660868:0:24947:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788581646.660874:0:24947:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788581646.660876:0:24947:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788581646.661007:0:24947:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff995e7fa4f000 00000020:01000004:1.0:1788581646.661027:0:24947:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788581646.661046:0:24947:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788581646.661064:0:24947:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff995d42c00000) 00000020:00000080:1.0:1788581646.661086:0:24947:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00000100:00080000:3.0:1788581646.661636:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581646.661642:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788581646.661645:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581646.661648:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788581646.661714:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184301568:0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.661809:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581646.661872:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581646.661879:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184301696:0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.661909:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581646.661947:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184301568 00000100:00100000:0.0:1788581646.661955:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184301568 00000100:00100000:0.0:1788581646.662013:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788581646.662024:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:3620:x1875463184301568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.662083:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:3620:x1875463184301568:12345-0@lo:400:kworker.0 Request processed in 60us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581646.662090:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788581646.662128:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184301824:0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.662156:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581646.662201:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184301824 00000100:00100000:0.0:1788581646.662214:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184301824 00000100:00100000:0.0:1788581646.662247:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788581646.662276:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184301824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.662316:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184301824:12345-0@lo:400:kworker.0 Request processed in 63us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581646.662322:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788581646.662365:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d43836680 x1875463184301824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581646.662383:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184301824:0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.662420:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184301568:0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.662855:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184301696 00000100:00100000:0.0:1788581646.662861:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184301696 00000100:00100000:0.0:1788581646.662895:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788581646.662901:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184301696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.662951:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184301696:12345-0@lo:400:kworker.0 Request processed in 50us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581646.662958:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788581646.663004:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184301696:0@lo:400:kworker.0 00000100:00100000:2.0:1788581646.666694:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184301440 00000100:00100000:2.0:1788581646.666715:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184301440 00000100:00100000:2.0:1788581646.666803:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581646.666817:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e550afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184301440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788581646.666862:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788581646.666974:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e550afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184301440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 160us (8663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581646.666982:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788581646.667038:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e45150e00 x1875463184301440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581662 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581646.667079:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184301440:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788581646.667314:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581646.667448:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788581646.667454:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788581646.667458:0:8:0:(import.c:65:import_set_state_nolock()) ffff995e6f8e2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788581646.667464:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 627 00000100:00080000:3.0:1788581646.667470:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788581646.667475:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff995e6f8e2800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1788581646.667502:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d43834e00 x1875463184302080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788581646.667578:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184302080:0@lo:8:kworker.0 00000100:00100000:3.0:1788581646.667642:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581646.667691:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184302080 00000100:00100000:3.0:1788581646.667696:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184302080 00000100:00100000:3.0:1788581646.667727:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788581646.667733:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875463184302080:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788581646.667757:0:24131:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788581646.667797:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875463184302080:12345-0@lo:8:kworker.0 Request processed in 62us (155us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788581646.667826:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788581646.667862:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e6f8e2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581646.667867:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788581646.667871:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184302080:0@lo:8:kworker.0 00000100:00100000:3.0:1788581646.667913:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875463184302336:0@lo:400:kworker.0 00000100:00100000:3.0:1788581646.667949:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581646.667974:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581646.667980:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184302208:0@lo:400:kworker.0 00000100:00100000:3.0:1788581646.668004:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581646.668034:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184302336 00000100:00100000:3.0:1788581646.668038:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184302336 00000100:00100000:0.0:1788581646.668281:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184302464:0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.668320:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581646.668344:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581646.668350:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184301952:0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.668377:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581646.668403:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184301952 00000100:00100000:0.0:1788581646.668415:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184301952 00000100:00100000:0.0:1788581646.668449:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788581646.668457:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184301952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.668503:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184301952:12345-0@lo:400:kworker.0 Request processed in 47us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581646.668509:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788581646.668537:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184302208 00000100:00100000:0.0:1788581646.668541:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184302208 00000100:00100000:3.0:1788581646.668735:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184302464 00000100:00100000:3.0:1788581646.668739:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184302464 00000100:00100000:2.0:1788581646.669331:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788581646.669345:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875463184302336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581646.669404:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875463184302336:12345-0@lo:400:kworker.0 Request processed in 64us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581646.669419:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788581646.671543:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581646.671566:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184302208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.671687:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875463184302208:12345-0@lo:400:kworker.0 Request processed in 131us (3681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581646.671694:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581646.671766:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184301952:0@lo:400:kworker.0 00000100:00100000:3.0:1788581646.672364:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788581646.672378:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184302464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581646.672440:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875463184302464:12345-0@lo:400:kworker.0 Request processed in 69us (4119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581646.672446:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788581646.672516:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d43837100 x1875463184302464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581646.672531:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875463184302464:0@lo:400:kworker.0 00000100:00080000:3.0:1788581646.672780:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581646.672786:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788581646.674584:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d43835180 x1875463184302208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581646.674715:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875463184302208:0@lo:400:kworker.0 00010000:00080000:2.0:1788581646.674738:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d43836680 x1875463184302336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581646.674749:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875463184302336:0@lo:400:kworker.0 00100000:10000000:3.0:1788581646.757955:0:24947:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788581646.760545:0:24947:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788581646.761041:0:24947:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788581646.761398:0:24947:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788581646.761680:0:24947:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788581646.761944:0:24947:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788581646.762198:0:24947:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1788581646.763558:0:24947:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788581646.763855:0:24947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788581646.763875:0:24947:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788581646.763891:0:24947:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x50f0cc74b7b31874 00000020:01000004:2.0:1788581646.763901:0:24947:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788581646.763934:0:24947:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788581646.763939:0:24947:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788581646.763948:0:24947:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788581646.763990:0:24947:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788581646.763995:0:24947:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788581646.798513:0:24947:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788581646.798567:0:24947:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.103@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788581646.798572:0:24947:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788581646.798574:0:24947:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788581646.798576:0:24947:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581646.798577:0:24947:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581646.798578:0:24947:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581646.798580:0:24947:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581646.798582:0:24947:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788581646.798584:0:24947:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581646.798585:0:24947:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788581646.798590:0:24947:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788581646.798592:0:24947:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788581646.798593:0:24947:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788581646.798595:0:24947:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581646.798596:0:24947:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581646.798597:0:24947:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581646.798598:0:24947:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581646.798599:0:24947:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788581646.798600:0:24947:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581646.798601:0:24947:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788581646.798647:0:24947:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788581646.798680:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184302592:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788581646.798778:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581646.799169:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788581646.799222:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184302592 00000100:00100000:1.0:1788581646.799232:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184302592 00000100:00100000:1.0:1788581646.799525:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788581646.799539:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:24947:x1875463184302592:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788581646.799583:0:22621:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788581646.799587:0:22621:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788581646.799591:0:22621:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788581646.800143:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:24947:x1875463184302592:12345-0@lo:253:mount.lustre.0 Request processed in 605us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581646.800153:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788581646.800292:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184302592:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788581646.800307:0:24947:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788581646.800310:0:24947:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788581646.800324:0:24947:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788581646.800326:0:24947:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581646.800327:0:24947:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581646.800328:0:24947:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581646.800330:0:24947:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581646.800331:0:24947:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788581646.800333:0:24947:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581646.800334:0:24947:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788581646.800357:0:24947:0:(tgt_mount.c:101:server_register_mount()) register mount ffff995e7fa4f000 from lustre-OST0001 10000000:01000000:3.0:1788581646.800388:0:24947:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788581646.800391:0:24947:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788581646.800402:0:24947:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff995e47874d28 local copy 00010000:00010000:3.0:1788581646.800413:0:24947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b3158e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31595 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581646.800537:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184302720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581646.800574:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581646.808340:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184302720 00000100:00100000:0.0:1788581646.808361:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184302720 00000100:00100000:3.0:1788581646.808377:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788581646.809825:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788581646.809853:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:24947:x1875463184302720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581646.810069:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:24947:x1875463184302720:12345-0@lo:501:mount.lustre.0 Request processed in 229us (9493us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581646.810078:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788581646.810909:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184302720:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788581646.810944:0:24947:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788581646.810986:0:24947:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788581646.810997:0:24947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b3158e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31595 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.811011:0:24947:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e49e6a200/0x50f0cc74b7b3158e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31595 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581646.811052:0:24947:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff995e7fa4f000 10000000:01000000:3.0:1788581646.811058:0:24947:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788581646.811066:0:24947:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788581646.811070:0:24947:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788581646.811095:0:24947:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788581646.811098:0:24947:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788581646.811141:0:24947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3187b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.811150:0:24947:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3187b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.811161:0:24947:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3187b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581646.811199:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184302848:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788581646.811279:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581646.811322:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788581646.811349:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184302848 00000100:00100000:0.0:1788581646.811357:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184302848 00000100:00100000:0.0:1788581646.811412:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788581646.811422:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:24947:x1875463184302848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581646.811437:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581646.811454:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995d43273400/0x50f0cc74b7b31882 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b3187b expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.811492:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995d43273400/0x50f0cc74b7b31882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b3187b expref: 22 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.811505:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995d43273400/0x50f0cc74b7b31882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b3187b expref: 22 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.811523:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995d43273400, rc 0) 00000100:00100000:0.0:1788581646.811570:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:24947:x1875463184302848:12345-0@lo:101:mount.lustre.0 Request processed in 149us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581646.811577:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788581646.811721:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184302848:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581646.811735:0:24947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3187b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31882 expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.811745:0:24947:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3187b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31882 expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788581646.816852:0:24947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788581646.818085:0:24947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788581646.819981:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788581646.820047:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788581646.820064:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788581646.820089:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788581646.820104:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788581646.820117:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788581646.820130:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788581646.820143:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788581646.820156:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788581646.820196:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788581646.820203:0:24947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788581646.820390:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184302976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581646.820483:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581646.820542:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788581646.820721:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184302976 00000100:00100000:1.0:1788581646.820731:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184302976 00000100:00100000:1.0:1788581646.820817:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788581646.820832:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:24947:x1875463184302976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581646.821050:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:24947:x1875463184302976:12345-0@lo:501:mount.lustre.0 Request processed in 222us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581646.821059:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788581646.821243:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184302976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581646.821317:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184303104:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581646.821361:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581646.821458:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4e9f7900 going to sleep for 11 seconds 00000100:00100000:0.0:1788581646.821920:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184303104 00000100:00100000:0.0:1788581646.821928:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184303104 00000100:00100000:0.0:1788581646.821978:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788581646.821987:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:24947:x1875463184303104:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788581646.822814:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:24947:x1875463184303104:12345-0@lo:503:mount.lustre.0 Request processed in 824us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581646.822825:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788581646.823093:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184303104:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788581646.823898:0:24947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788581646.824012:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184303232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581646.824086:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581646.824167:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e478bb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788581646.824462:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184303232 00000100:00100000:3.0:1788581646.824471:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184303232 00000100:00100000:2.0:1788581646.824859:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788581646.824872:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:24947:x1875463184303232:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581646.825505:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:24947:x1875463184303232:12345-0@lo:502:mount.lustre.0 Request processed in 633us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581646.825516:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788581646.825649:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184303232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581646.825943:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788581646.825999:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788581646.826019:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788581646.826037:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788581646.826053:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788581646.826070:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788581646.826087:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788581646.826104:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788581646.826120:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1788581646.826165:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184303360:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581646.826230:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581646.826312:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e527fb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788581646.826507:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184303360 00000100:00100000:2.0:1788581646.826523:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184303360 00000100:00100000:2.0:1788581646.826566:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788581646.826575:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:24947:x1875463184303360:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581646.826704:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:24947:x1875463184303360:12345-0@lo:502:mount.lustre.0 Request processed in 129us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581646.826711:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788581646.826893:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184303360:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581646.826951:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1788581646.826969:0:24947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788581646.827898:0:24951:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788581646.827910:0:24951:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788581646.827917:0:24951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581646.827919:0:24951:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788581646.827926:0:24951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788581646.827945:0:24951:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff995d42c019b8) 00000020:00000080:1.0:1788581646.827973:0:24951:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788581646.827979:0:24951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788581646.828073:0:24951:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e7fa4f000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788581646.828090:0:24951:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788581646.828099:0:24951:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x50f0cc74b7b31890 00010000:00010000:1.0:1788581646.833973:0:24951:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788581646.834739:0:24951:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:0.0:1788581646.836949:0:24951:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788581646.840300:0:24951:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788581646.840319:0:24951:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581646.840327:0:24951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581646.840330:0:24951:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788581646.840334:0:24951:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581646.840339:0:24951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581646.840358:0:24951:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788581646.840362:0:24951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788581646.840364:0:24951:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788581646.840367:0:24951:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581646.840369:0:24951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581646.840371:0:24951:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788581646.840373:0:24951:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581646.840376:0:24951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581646.840377:0:24951:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788581646.840380:0:24951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788581646.840422:0:24951:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581646.840426:0:24951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581646.840427:0:24951:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788581646.840431:0:24951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1788581646.841864:0:24947:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788581646.841915:0:24947:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788581646.841943:0:24947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3187b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31882 expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.841959:0:24947:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e49e6ba00/0x50f0cc74b7b3187b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31882 expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581646.841969:0:24947:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e7fa4f000 from 1 10000000:01000000:0.0:1788581646.841972:0:24947:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581646.842027:0:24947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43272400/0x50f0cc74b7b31897 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.842037:0:24947:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995d43272400/0x50f0cc74b7b31897 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.842065:0:24947:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995d43272400/0x50f0cc74b7b31897 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581646.842101:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45150e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184303488:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788581646.842204:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581646.842277:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a617600 going to sleep for 11 seconds 00000100:00100000:3.0:1788581646.844870:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184303488 00000100:00100000:3.0:1788581646.844891:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184303488 00000100:00100000:3.0:1788581646.844980:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788581646.844993:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:24947:x1875463184303488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581646.845014:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581646.845037:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b3189e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b31897 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.845073:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b3189e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b31897 expref: 23 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.845085:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b3189e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31897 expref: 23 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.845096:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b800, rc 0) 00000100:00100000:3.0:1788581646.845200:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:24947:x1875463184303488:12345-0@lo:101:mount.lustre.0 Request processed in 209us (2995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581646.845208:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788581646.845490:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45150e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184303488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581646.845513:0:24947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995d43272400/0x50f0cc74b7b31897 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3189e expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.845524:0:24947:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995d43272400/0x50f0cc74b7b31897 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b3189e expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788581646.848751:0:24947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1788581646.849163:0:24947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788581646.849453:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788581646.849487:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788581646.849503:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788581646.849518:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788581646.849533:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788581646.849548:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788581646.849564:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788581646.849580:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788581646.849595:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788581646.849624:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788581646.849644:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788581646.849664:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788581646.849670:0:24947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788581646.849768:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45150e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184303616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581646.849871:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581646.849940:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a6170c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581646.852484:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184303616 00000100:00100000:3.0:1788581646.852504:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184303616 00000100:00100000:3.0:1788581646.852584:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788581646.852598:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:24947:x1875463184303616:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581646.852842:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:24947:x1875463184303616:12345-0@lo:501:mount.lustre.0 Request processed in 246us (2970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581646.852850:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788581646.855121:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45150e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184303616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581646.856857:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45150e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184303744:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788581646.856989:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581646.857071:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184303744 00000100:00100000:0.0:1788581646.857082:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184303744 00000100:00100000:1.0:1788581646.858745:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a6170c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581646.858886:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788581646.858910:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:24947:x1875463184303744:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788581646.859137:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:24947:x1875463184303744:12345-0@lo:503:mount.lustre.0 Request processed in 238us (2147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581646.859145:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788581646.861768:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45150e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184303744:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788581646.862468:0:24947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581646.862605:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184303872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581646.862716:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581646.867120:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a617600 going to sleep for 11 seconds 00000100:00100000:3.0:1788581646.867206:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184303872 00000100:00100000:3.0:1788581646.867221:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184303872 00000100:00100000:3.0:1788581646.867321:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788581646.867333:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:24947:x1875463184303872:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581646.867563:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:24947:x1875463184303872:12345-0@lo:502:mount.lustre.0 Request processed in 231us (4846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581646.867572:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788581646.871041:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184303872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581646.871417:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788581646.871458:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788581646.871472:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788581646.871486:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788581646.871500:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788581646.871512:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788581646.871523:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788581646.871534:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788581646.871544:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788581646.871554:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788581646.871566:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788581646.871625:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184304000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581646.871860:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581646.871917:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a617600 going to sleep for 11 seconds 00000100:00100000:2.0:1788581646.872019:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184304000 00000100:00100000:2.0:1788581646.872029:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184304000 00000100:00100000:2.0:1788581646.872093:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788581646.872105:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:24947:x1875463184304000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581646.872284:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:24947:x1875463184304000:12345-0@lo:502:mount.lustre.0 Request processed in 180us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581646.872293:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788581646.872356:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f616a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184304000:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788581646.872417:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788581646.872430:0:24947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788581646.873592:0:24955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581646.873607:0:24955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581646.873619:0:24955:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788581646.873627:0:24955:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e7fa4f000 00000020:00000080:2.0:1788581646.873630:0:24955:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788581646.873639:0:24955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581646.873642:0:24955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581646.873643:0:24955:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788581646.873646:0:24955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581646.873648:0:24955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581646.873649:0:24955:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788581646.873652:0:24955:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff995e7fa4f000 00000020:00000080:2.0:1788581646.873654:0:24955:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788581646.873893:0:24955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581646.873898:0:24955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581646.873900:0:24955:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788581646.873903:0:24955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581646.873906:0:24955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581646.873907:0:24955:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788581646.873910:0:24955:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e7fa4f000 00000020:00000080:2.0:1788581646.873913:0:24955:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788581646.881472:0:24955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581646.881691:0:24955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581646.881696:0:24955:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788581646.881702:0:24955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581646.881708:0:24955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581646.881710:0:24955:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788581646.881715:0:24955:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff995e7fa4f000 00000020:00000080:3.0:1788581646.881718:0:24955:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788581646.881831:0:24955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581646.881835:0:24955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581646.881836:0:24955:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788581646.881840:0:24955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1788581646.883356:0:24947:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788581646.883413:0:24947:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581646.883442:0:24947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995d43272400/0x50f0cc74b7b31897 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3189e expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581646.883465:0:24947:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995d43272400/0x50f0cc74b7b31897 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b3189e expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581646.883538:0:24947:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788581646.883542:0:24947:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff995e7fa4f000 10000000:01000000:1.0:1788581646.883546:0:24947:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff995e7fa4f000 10000000:01000000:1.0:1788581646.883563:0:24947:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788581646.883571:0:24947:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff995e7fa4f000 from 1 10000000:01000000:1.0:1788581646.883574:0:24947:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788581646.883621:0:24947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42ccbc00/0x50f0cc74b7b318a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581646.883630:0:24947:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42ccbc00/0x50f0cc74b7b318a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581646.883643:0:24947:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42ccbc00/0x50f0cc74b7b318a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581646.883672:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184304128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788581646.883766:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581646.883815:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a617600 going to sleep for 11 seconds 00000100:00100000:2.0:1788581646.884372:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184304128 00000100:00100000:2.0:1788581646.884383:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184304128 00000100:00100000:2.0:1788581646.884443:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788581646.884455:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:24947:x1875463184304128:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581646.884473:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581646.884491:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0f800/0x50f0cc74b7b318ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b318a5 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581646.884523:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0f800/0x50f0cc74b7b318ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b318a5 expref: 24 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581646.884536:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0f800/0x50f0cc74b7b318ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b318a5 expref: 24 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581646.884547:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0f800, rc 0) 00000100:00100000:1.0:1788581646.884754:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184304128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581646.884773:0:24947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42ccbc00/0x50f0cc74b7b318a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b318ac expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581646.884783:0:24947:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42ccbc00/0x50f0cc74b7b318a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b318ac expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581646.885655:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:24947:x1875463184304128:12345-0@lo:101:mount.lustre.0 Request processed in 1195us (1883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581646.885772:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000040:00080000:1.0:1788581646.887923:0:24947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1788581646.888377:0:24947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581646.888630:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788581646.894753:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788581646.894878:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788581646.894897:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788581646.894913:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788581646.894929:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788581646.894942:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788581646.894957:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788581646.894972:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788581646.894985:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788581646.894998:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788581646.895014:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788581646.895049:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788581646.895066:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788581646.895081:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788581646.895098:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788581646.895113:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788581646.895127:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788581646.895139:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788581646.895152:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788581646.895165:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788581646.895177:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788581646.895204:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788581646.895218:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788581646.895229:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1788581646.895241:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1788581646.895279:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1788581646.895297:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1788581646.895328:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1788581646.895351:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1788581646.895364:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1788581646.895376:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1788581646.895387:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1788581646.895399:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1788581646.895411:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1788581646.895424:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1788581646.895438:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1788581646.895451:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1788581646.895464:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1788581646.895476:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1788581646.895489:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1788581646.895504:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1788581646.895517:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1788581646.895531:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1788581646.895560:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1788581646.895577:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1788581646.895592:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1788581646.895606:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1788581646.896000:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1788581646.896031:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1788581646.896053:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1788581646.896060:0:24947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1788581646.896219:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184304256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581646.896344:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581646.896404:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184304256 00000100:00100000:1.0:1788581646.896414:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184304256 00000100:00100000:1.0:1788581646.896478:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788581646.896490:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:24947:x1875463184304256:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581646.897791:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:24947:x1875463184304256:12345-0@lo:501:mount.lustre.0 Request processed in 1292us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581646.897820:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788581646.897914:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a6170c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581646.897951:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184304256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581646.898011:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184304384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581646.898089:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581646.898126:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e51d5d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788581646.898223:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184304384 00000100:00100000:2.0:1788581646.898231:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184304384 00000100:00100000:2.0:1788581646.898309:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788581646.898320:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:24947:x1875463184304384:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581646.898472:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:24947:x1875463184304384:12345-0@lo:503:mount.lustre.0 Request processed in 154us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581646.898480:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788581646.898603:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184304384:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788581646.901041:0:24947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788581646.901177:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45151c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184304512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581646.901330:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581646.901380:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7b13fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581646.901871:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184304512 00000100:00100000:1.0:1788581646.901883:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184304512 00000100:00100000:1.0:1788581646.901949:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788581646.901961:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:24947:x1875463184304512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581646.902132:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:24947:x1875463184304512:12345-0@lo:502:mount.lustre.0 Request processed in 173us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581646.902141:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788581646.902294:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45151c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184304512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788581646.902641:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788581646.902971:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788581646.903001:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788581646.903017:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788581646.903032:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788581646.903045:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788581646.903059:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788581646.903074:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788581646.903090:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788581646.903103:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788581646.903118:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788581646.903135:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788581646.903149:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788581646.903164:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788581646.903188:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788581646.903205:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788581646.903220:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788581646.903235:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788581646.903249:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788581646.903326:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788581646.903342:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788581646.903371:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788581646.903388:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788581646.903404:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788581646.903417:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1788581646.903431:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1788581646.903445:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1788581646.903458:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1788581646.903472:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1788581646.903487:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1788581646.903500:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1788581646.903513:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1788581646.903526:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1788581646.903539:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788581646.903554:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788581646.903580:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788581646.903594:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788581646.903619:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788581646.903636:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788581646.903648:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788581646.903743:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788581646.903759:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788581646.903970:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1788581646.903989:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788581646.904006:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788581646.904019:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788581646.904035:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788581646.904051:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788581646.904123:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184304640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581646.904225:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581646.904301:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6625c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788581646.906021:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184304640 00000100:00100000:1.0:1788581646.906040:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184304640 00000100:00100000:1.0:1788581646.906115:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788581646.906128:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:24947:x1875463184304640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581646.906368:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:24947:x1875463184304640:12345-0@lo:502:mount.lustre.0 Request processed in 242us (2142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581646.906378:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788581646.906470:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184304640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581646.907869:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1788581646.907927:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1788581646.907979:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184304768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581646.908066:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581646.908128:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184304768 00000100:00100000:1.0:1788581646.908136:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184304768 00000100:00100000:1.0:1788581646.908189:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788581646.908197:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:24947:x1875463184304768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581646.908326:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:24947:x1875463184304768:12345-0@lo:502:mount.lustre.0 Request processed in 129us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581646.908334:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788581646.908387:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a6170c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581646.908410:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184304768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581646.908456:0:24947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788581646.908465:0:24947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788581646.913089:0:24960:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788581646.913114:0:24960:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff995d42c03370) 00000020:00000080:1.0:1788581646.913150:0:24960:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788581646.913775:0:24960:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e7fa4f000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788581646.913783:0:24960:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e7fa4f000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788581646.913786:0:24960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e7fa4f000 3 00010000:00080000:1.0:1788581646.913846:0:24960:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995d439fa000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1788581646.923407:0:24960:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788581646.925607:0:24960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788581646.925674:0:24960:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788581646.925692:0:24960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x50f0cc74b7b318ba 00000100:00080000:1.0:1788581646.925705:0:24960:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788581646.925712:0:24960:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff995d439fa000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581646.925757:0:24960:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e7f615180 x1875463184304896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581646.925823:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184304896:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788581646.925916:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581646.925995:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184304896 00000100:00100000:1.0:1788581646.926003:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184304896 00000100:00100000:1.0:1788581646.926040:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581646.926049:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875463184304896:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788581646.926077:0:22627:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 633 last 0 00000020:00000080:1.0:1788581646.926120:0:22627:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x50f0cc74b7b318c1 00000004:00100000:1.0:1788581646.926141:0:22627:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788581646.932157:0:24960:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788581646.932790:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581646.932796:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788581646.932799:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581646.932803:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788581646.932844:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581646.932847:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788581646.932851:0:8:0:(import.c:65:import_set_state_nolock()) ffff995e6f8e2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581646.932863:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 632 00000100:00080000:2.0:1788581646.932869:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788581646.932878:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff995e6f8e2800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1788581646.932907:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e766e9500 x1875463184305536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581646.932969:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184305280:0@lo:400:kworker.0 00000100:00100000:2.0:1788581646.933058:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581646.933101:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184305920:0@lo:400:kworker.0 00000100:00100000:2.0:1788581646.933129:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581646.933157:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788581646.933162:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184305152:0@lo:400:kworker.0 00000100:00100000:2.0:1788581646.933195:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581646.933213:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875463184305792:0@lo:400:kworker.0 00000100:00100000:2.0:1788581646.933276:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581646.933311:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184305920 00000100:00100000:2.0:1788581646.933321:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184305920 00000100:00100000:2.0:1788581646.933370:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184305152 00000100:00100000:2.0:1788581646.933373:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184305152 00000100:00100000:2.0:1788581646.933388:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184305792 00000100:00100000:2.0:1788581646.933390:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184305792 00000100:00100000:2.0:1788581646.933407:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788581646.933416:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184305920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581646.933480:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184305920:12345-0@lo:400:kworker.0 Request processed in 64us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581646.933488:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788581646.933509:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788581646.933516:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184305152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581646.933545:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875463184305152:12345-0@lo:400:kworker.0 Request processed in 30us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581646.933551:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788581646.933562:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788581646.933567:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875463184305792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581646.933592:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875463184305792:12345-0@lo:400:kworker.0 Request processed in 25us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581646.933598:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788581646.933728:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184305024:0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.933764:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581646.933785:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184305664:0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.933804:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788581646.933873:0:22627:0:(import.c:65:import_set_state_nolock()) ffff995d439fd800 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1788581646.933957:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e766ebb80 x1875463184305152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581646.933973:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875463184305152:0@lo:400:kworker.0 00010000:00080000:2.0:1788581646.933982:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e766ead80 x1875463184305792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581646.933999:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875463184305792:0@lo:400:kworker.0 00010000:00080000:2.0:1788581646.934010:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e766e9180 x1875463184305920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581646.934018:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184305920:0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.934120:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581646.934128:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184305408:0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.934167:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581646.934214:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184305280 00000100:00100000:0.0:1788581646.934219:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184305280 00000100:00100000:0.0:1788581646.934275:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184305024 00000100:00100000:0.0:1788581646.934279:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184305024 00000100:00100000:0.0:1788581646.934295:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788581646.934302:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184305280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.934348:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184305280:12345-0@lo:400:kworker.0 Request processed in 46us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581646.934355:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788581646.934375:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788581646.934381:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184305024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.934413:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184305024:12345-0@lo:400:kworker.0 Request processed in 33us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581646.934420:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788581646.935920:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184305664 00000100:00100000:1.0:1788581646.935933:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184305664 00000100:00100000:1.0:1788581646.935997:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788581646.936008:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184305664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581646.936096:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184305664:12345-0@lo:400:kworker.0 Request processed in 90us (2290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581646.936103:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788581646.936173:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184305536:0@lo:8:kworker.0 00000100:00100000:1.0:1788581646.936231:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581646.936318:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184305408 00000100:00100000:1.0:1788581646.936323:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184305408 00000100:00100000:1.0:1788581646.936357:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184305536 00000100:00100000:1.0:1788581646.936360:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184305536 00000100:00100000:1.0:1788581646.936378:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581646.936384:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184305408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581646.936421:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184305408:12345-0@lo:400:kworker.0 Request processed in 37us (2253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581646.936452:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581646.936470:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788581646.936476:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3617:x1875463184305536:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788581646.936537:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3617:x1875463184305536:12345-0@lo:8:kworker.0 Request processed in 59us (304us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788581646.936544:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788581646.936596:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788581646.936605:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e6f8e2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788581646.936689:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788581646.936693:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184305536:0@lo:8:kworker.0 00000100:00100000:1.0:1788581646.936748:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875463184304896:12345-0@lo:38:llog_process_th.0 Request processed in 10699us (10832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581646.936757:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788581646.936788:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e7f615180 x1875463184304896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581646.936799:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788581646.936806:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788581646.936815:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788581646.936821:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788581646.936824:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d439fa000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788581646.936830:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875463184304896:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788581646.937285:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184305280:0@lo:400:kworker.0 00010000:00080000:0.0:1788581646.937326:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e766e8700 x1875463184305408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581646.937338:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184305408:0@lo:400:kworker.0 00000100:00100000:0.0:1788581646.937358:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184305024:0@lo:400:kworker.0 00010000:00080000:0.0:1788581646.937371:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995e766eb480 x1875463184305664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581646.937379:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184305664:0@lo:400:kworker.0 00000020:01000004:0.0:1788581646.938321:0:24960:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788581646.938359:0:24960:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff995d43178000) 00000020:00000080:0.0:1788581646.938394:0:24960:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788581646.938535:0:24960:0:(tgt_mount.c:153:server_get_mount()) get mount ffff995e7fa4f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788581646.938540:0:24960:0:(tgt_mount.c:187:server_put_mount()) put mount ffff995e7fa4f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788581646.938543:0:24960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff995e7fa4f000 3 00010000:00080000:0.0:1788581646.938579:0:24960:0:(ldlm_lib.c:102:import_set_conn()) imp ffff995d438ff800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1788581646.941817:0:24960:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788581646.942174:0:24960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788581646.942869:0:24960:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788581646.942892:0:24960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x50f0cc74b7b318cf 00000100:00080000:1.0:1788581646.942915:0:24960:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788581646.942923:0:24960:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff995d438ff800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1788581646.942989:0:24960:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995d432caa00 x1875463184306048/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788581646.943016:0:24960:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788581646.943057:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581646.943063:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581646.943066:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581646.943069:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788581646.943382:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875463184306048:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788581646.943497:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581646.943578:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184306048 00000100:00100000:1.0:1788581646.943587:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184306048 00000100:00100000:1.0:1788581646.943643:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788581646.943653:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875463184306048:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788581646.943689:0:22628:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 633 last 0 00000020:00000080:1.0:1788581646.943729:0:22628:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x50f0cc74b7b318d6 00000004:00100000:1.0:1788581646.943750:0:22628:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788581646.943797:0:22628:0:(import.c:65:import_set_state_nolock()) ffff995d439fd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581646.943865:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875463184306048:12345-0@lo:38:llog_process_th.0 Request processed in 211us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581646.943873:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788581646.943918:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff995d432caa00 x1875463184306048/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581646.943944:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788581646.943954:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788581646.943962:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788581646.943968:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788581646.943971:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995d438ff800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788581646.943978:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875463184306048:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788581646.945939:0:24960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1788581646.946133:0:24947:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788581646.946171:0:24947:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788581646.946212:0:24947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42ccbc00/0x50f0cc74b7b318a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b318ac expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581646.946226:0:24947:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42ccbc00/0x50f0cc74b7b318a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b318ac expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788581646.946325:0:24947:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788581646.946327:0:24947:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788581646.946329:0:24947:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581646.946330:0:24947:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581646.946331:0:24947:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581646.946332:0:24947:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581646.946334:0:24947:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788581646.946336:0:24947:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581646.946338:0:24947:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788581646.948716:0:24947:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788581646.948729:0:24947:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788581646.948731:0:24947:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788581646.948732:0:24947:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581646.948733:0:24947:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581646.948735:0:24947:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581646.948736:0:24947:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581646.948738:0:24947:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788581646.948740:0:24947:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581646.948741:0:24947:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788581646.948782:0:24947:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788581646.948817:0:24947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b64c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184306176:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788581646.948914:0:24947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581646.948981:0:24947:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a48e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788581646.949232:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184306176 00000100:00100000:3.0:1788581646.949243:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184306176 00000100:00100000:3.0:1788581646.949424:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788581646.949436:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:24947:x1875463184306176:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788581646.949475:0:22622:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788581646.949493:0:22622:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788581646.958432:0:22622:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788581646.958458:0:22622:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788581646.958513:0:22642:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788581646.958520:0:22642:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788581646.958550:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995e49e6a600/0x50f0cc74b7b318dd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.958574:0:22642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42b0f200/0x50f0cc74b7b31851 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b3184a expref: 24 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.958583:0:22642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b3185f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31858 expref: 24 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.958611:0:22642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995e49e6a600/0x50f0cc74b7b318dd lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.958663:0:22642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b3185f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b31858 expref: 24 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.958679:0:22642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b3185f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b31858 expref: 24 pid: 22621 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581646.958696:0:22642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875463184306304:0@lo:104: 00000100:00100000:3.0:1788581646.958798:0:22642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581646.958873:0:22642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42b0f200/0x50f0cc74b7b31851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b3184a expref: 24 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581646.958874:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:24947:x1875463184306176:12345-0@lo:253:mount.lustre.0 Request processed in 9434us (9954us total) trans 0 rc 0/0 00010000:00010000:3.0:1788581646.958893:0:22642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e42b0f200/0x50f0cc74b7b31851 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b3184a expref: 24 pid: 22622 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581646.958900:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788581646.958908:0:22642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875463184306432:0@lo:104: 00000100:00100000:3.0:1788581646.958936:0:22642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581646.958958:0:22642:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e52c49900 going to sleep for 11 seconds 00000100:00100000:2.0:1788581646.958979:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184306304 00000100:00100000:2.0:1788581646.958989:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184306304 00000100:00100000:2.0:1788581646.959029:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184306432 00000100:00100000:2.0:1788581646.959032:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184306432 00000100:00100000:2.0:1788581646.959048:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788581646.959058:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+4:22642:x1875463184306304:12345-0@lo:104: 00010000:00010000:2.0:1788581646.959073:0:22611:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b31858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b3185f expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581646.959148:0:22611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788581646.959154:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+4:22642:x1875463184306304:12345-0@lo:104: Request processed in 98us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581646.959161:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788581646.959189:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788581646.959198:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43836300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+3:22642:x1875463184306432:12345-0@lo:104: 00010000:00010000:2.0:1788581646.959207:0:22611:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b3184a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b31851 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581646.959214:0:22642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43837100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875463184306304:0@lo:104: 00010000:00010000:2.0:1788581646.959284:0:22611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788581646.959290:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43836300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+3:22642:x1875463184306432:12345-0@lo:104: Request processed in 95us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581646.959309:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788581646.959346:0:24947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b64c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a361c037-f8ee-420d-b76d-dbdb9328e15d:24947:1875463184306176:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788581646.959359:0:24947:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788581646.959363:0:24947:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788581646.959364:0:24947:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788581646.959365:0:24947:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581646.959367:0:24947:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581646.959368:0:24947:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581646.959369:0:24947:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581646.959371:0:24947:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788581646.959373:0:24947:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581646.959375:0:24947:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788581646.959392:0:24947:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788581646.959933:0:22642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875463184306432:0@lo:104: 00010000:00010000:3.0:1788581646.959966:0:22642:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995e49e6a600/0x50f0cc74b7b318dd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.961485:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581646.961504:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b31858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b3185f expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.961516:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581646.961522:0:22616:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b31858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b3185f expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.961533:0:22616:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b31858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b3185f expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581646.961542:0:22616:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b31858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b3185f expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581646.961549:0:22616:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581646.961627:0:22616:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b31858 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b3185f expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.961634:0:22616:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581646.961670:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b31858 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b3185f expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.961678:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e42b0e200/0x50f0cc74b7b31858 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b3185f expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.961725:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581646.961728:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b3184a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b31851 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.961735:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccbe00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581646.961739:0:22616:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b3184a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b31851 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.961747:0:22616:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b3184a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b31851 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581646.961755:0:22616:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b3184a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b31851 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581646.961761:0:22616:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581646.961778:0:22616:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b3184a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31851 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.961784:0:22616:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581646.961790:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b3184a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31851 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.961797:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b3184a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31851 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.961812:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581646.961814:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581646.961816:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581646.961842:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a361c037-f8ee-420d-b76d-dbdb9328e15d:3619:1875463184306688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581646.961936:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581646.962010:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581646.962016:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184306688 00000100:00100000:0.0:1788581646.962017:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a361c037-f8ee-420d-b76d-dbdb9328e15d:3619:1875463184306560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581646.962026:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184306688 00000100:00100000:0.0:1788581646.962044:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581646.962069:0:22614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42b0f200/0x50f0cc74b7b31851 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b3184a expref: 24 pid: 22622 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581646.962078:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184306560 00000100:00100000:0.0:1788581646.962084:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184306560 00010000:00010000:0.0:1788581646.962105:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b3185f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b31858 expref: 25 pid: 22621 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581646.962121:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581646.962132:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a361c037-f8ee-420d-b76d-dbdb9328e15d+25:3619:x1875463184306688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581646.962150:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788581646.962150:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788581646.962160:0:22614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42b0f200/0x50f0cc74b7b31851 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b3184a expref: 25 pid: 22622 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581646.962166:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6face680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+25:3619:x1875463184306560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581646.962177:0:22614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42b0f200/0x50f0cc74b7b31851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b3184a expref: 25 pid: 22622 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.962189:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581646.962198:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b3185f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b31858 expref: 25 pid: 22621 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.962210:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0f200/0x50f0cc74b7b31851 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b3184a expref: 25 pid: 22622 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.962213:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b3185f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b31858 expref: 25 pid: 22621 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.962235:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b3185f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b31858 expref: 24 pid: 22621 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.962240:0:22614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995e49e6a600/0x50f0cc74b7b318dd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.962251:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6a600/0x50f0cc74b7b318dd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581646.962659:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581646.966728:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581646.966870:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6face680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:3619:x1875463184306560:12345-0@lo:103:ldlm_bl.0 Request processed in 4702us (4818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581646.966885:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581646.967784:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a361c037-f8ee-420d-b76d-dbdb9328e15d:3619:1875463184306560:0@lo:103:ldlm_bl.0 20000000:01000000:3.0:1788581646.969608:0:22614:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.026306895s 00010000:00010000:3.0:1788581646.969627:0:22614:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e49e6a600/0x50f0cc74b7b318dd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.969639:0:22614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e49e6a600/0x50f0cc74b7b318dd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.969646:0:22614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995e49e6a600/0x50f0cc74b7b318dd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.969654:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995e49e6a600/0x50f0cc74b7b318dd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.969679:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581646.969684:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995e49e6a600/0x50f0cc74b7b318dd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.969694:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995e49e6a600/0x50f0cc74b7b318dd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.969729:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995e49e6a600/0x50f0cc74b7b318dd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581646.969746:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581646.969862:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:3619:x1875463184306688:12345-0@lo:103:ldlm_bl.0 Request processed in 7727us (7921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581646.969874:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788581646.971744:0:22642:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995e49e6a600/0x50f0cc74b7b318dd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.971766:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995e49e6a600/0x50f0cc74b7b318dd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581646.971786:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6a600/0x50f0cc74b7b318dd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581646.973376:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a361c037-f8ee-420d-b76d-dbdb9328e15d:3619:1875463184306688:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1788581646.978939:0:24947:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788581646.982883:0:24947:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788581646.982895:0:24947:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788581646.982947:0:24947:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788581646.983011:0:24947:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788581646.983033:0:24947:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788581646.983066:0:24947:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788581646.984005:0:24947:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788581646.984344:0:24947:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788581647.171464:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581647.171496:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184306816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581647.171589:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581647.171894:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184306816 00000100:00100000:1.0:1788581647.171911:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184306816 00000100:00100000:3.0:1788581647.172059:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788581647.172074:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184306816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788581647.172121:0:23367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788581647.172203:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184306816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581647.172213:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788581647.172450:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184306816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788581647.172572:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581647.172589:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b64c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184306944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581647.172769:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581647.172832:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184306944 00000100:00100000:2.0:1788581647.172840:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184306944 00000100:00100000:2.0:1788581647.172891:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788581647.172903:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184306944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788581647.172933:0:22631:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788581647.172982:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184306944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581647.173010:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788581647.173073:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b64c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184306944:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788581647.617439:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788581647.825098:0:25014:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788581647.825483:0:25014:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788581648.005942:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581627/real 1788581627] req@ffff995e766e8380 x1875463184293120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581647 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581648.005970:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995e766e8380 x1875463184293120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581647 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581648.005980:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581627/real 1788581627] req@ffff995e766e8000 x1875463184293248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581647 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581648.005992:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff995e766e8000 x1875463184293248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581647 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788581648.006010:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4eb3a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788581648.006025:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788581648.006028:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184293120:0@lo:8:kworker.0 00000100:00080000:0.0:1788581648.006034:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e48649800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788581648.006038:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788581648.006041:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184293248:0@lo:8:kworker.0 00000100:00080000:0.0:1788581648.006142:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788581648.006145:0:15242:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788581648.006158:0:15242:0:(import.c:65:import_set_state_nolock()) ffff995e4eb3a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788581648.006163:0:15242:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 613 00000100:00080000:0.0:1788581648.006167:0:15242:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788581648.006183:0:15242:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff995e4eb3a800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581648.006202:0:15242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e6face300 x1875463184307328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788581648.006215:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788581648.006218:0:15242:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788581648.006220:0:15242:0:(import.c:65:import_set_state_nolock()) ffff995e48649800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788581648.006223:0:15242:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 613 00000100:00080000:0.0:1788581648.006225:0:15242:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788581648.006228:0:15242:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff995e48649800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581648.006236:0:15242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e6facf100 x1875463184307456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788581648.006296:0:15242:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788581648.006299:0:15242:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788581648.006300:0:15242:0:(import.c:65:import_set_state_nolock()) ffff995e6f8e2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788581648.006305:0:15242:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff995e6f8e2800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1788581648.006314:0:15242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff995e6facd180 x1875463184307968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788581648.006359:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a361c037-f8ee-420d-b76d-dbdb9328e15d:3618:1875463184307072:0@lo:400:kworker.0 00000100:00100000:0.0:1788581648.006416:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581648.006450:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184307840:0@lo:400:kworker.0 00000100:00100000:0.0:1788581648.006471:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581648.006495:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184308480:0@lo:400:kworker.0 00000100:00100000:0.0:1788581648.006519:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581648.006536:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788581648.006541:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184307200:0@lo:400:kworker.0 00000100:00100000:0.0:1788581648.006563:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581648.006591:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184308096:0@lo:400:kworker.0 00000100:00100000:0.0:1788581648.006609:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581648.006622:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184308608:0@lo:400:kworker.0 00000100:00100000:0.0:1788581648.006640:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581648.006665:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184307712:0@lo:400:kworker.0 00000100:00100000:0.0:1788581648.006670:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184307584:0@lo:400:kworker.0 00000100:00100000:1.0:1788581648.006713:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581648.006714:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581648.006733:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184308224:0@lo:400:kworker.0 00000100:00100000:1.0:1788581648.006745:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184308352:0@lo:400:kworker.0 00000100:00100000:1.0:1788581648.006769:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581648.006799:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184307072 00000100:00100000:1.0:1788581648.006806:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184307072 00000100:00100000:1.0:1788581648.006850:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788581648.006860:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:3618:x1875463184307072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581648.006871:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581648.006901:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184307840 00000100:00100000:0.0:1788581648.006905:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184307840 00000100:00100000:1.0:1788581648.006917:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:3618:x1875463184307072:12345-0@lo:400:kworker.0 Request processed in 57us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581648.006925:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788581648.006949:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788581648.006959:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184307840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581648.006962:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184308480 00000100:00100000:1.0:1788581648.006974:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184308480 00000100:00100000:0.0:1788581648.006997:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184307840:12345-0@lo:400:kworker.0 Request processed in 40us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581648.007003:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184308096 00000100:00100000:0.0:1788581648.007005:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581648.007008:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184308096 00000100:00100000:1.0:1788581648.007025:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184308608 00000100:00100000:1.0:1788581648.007029:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184308608 00000100:00100000:0.0:1788581648.007033:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184307584 00000100:00100000:0.0:1788581648.007038:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184307584 00000100:00100000:1.0:1788581648.007046:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184308352 00000100:00100000:1.0:1788581648.007051:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184308352 00000100:00100000:0.0:1788581648.007060:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184308224 00000100:00100000:0.0:1788581648.007063:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184308224 00000100:00100000:1.0:1788581648.007077:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788581648.007665:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184308480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581648.007706:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184308480:12345-0@lo:400:kworker.0 Request processed in 621us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581648.008191:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788581648.008201:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184308096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581648.008249:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184308096:12345-0@lo:400:kworker.0 Request processed in 51us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581648.008351:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788581648.008370:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788581648.008377:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184308608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581648.008408:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184308608:12345-0@lo:400:kworker.0 Request processed in 33us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581648.008413:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788581648.008425:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788581648.008432:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184307584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581648.008467:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184307584:12345-0@lo:400:kworker.0 Request processed in 36us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581648.008473:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788581648.008486:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581648.008491:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184308352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581648.008541:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184308352:12345-0@lo:400:kworker.0 Request processed in 50us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581648.008548:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581648.008562:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788581648.008568:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184308224:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788581648.008704:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facf800 x1875463184307584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581648.008719:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184307584:0@lo:400:kworker.0 00000100:00100000:0.0:1788581648.009029:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184308224:12345-0@lo:400:kworker.0 Request processed in 461us (2158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581648.009036:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788581648.009060:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184307200 00000100:00100000:0.0:1788581648.009068:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184307200 00000100:00100000:0.0:1788581648.009109:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184307712 00000100:00100000:0.0:1788581648.009113:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184307712 00000100:00100000:0.0:1788581648.009126:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788581648.009132:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184307200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581648.009169:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184307200:12345-0@lo:400:kworker.0 Request processed in 37us (2604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581648.009186:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788581648.009199:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788581648.009204:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184307712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581648.009231:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184307712:12345-0@lo:400:kworker.0 Request processed in 27us (2523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581648.009236:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788581648.009273:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788581648.009278:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788581648.009280:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581648.009304:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6face300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184307328:0@lo:8:kworker.0 00000100:00100000:0.0:1788581648.009343:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581648.009377:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184307456:0@lo:8:kworker.0 00000100:00100000:0.0:1788581648.009403:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581648.009419:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184307968:0@lo:8:kworker.0 00000100:00100000:0.0:1788581648.009441:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581648.009473:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184307328 00000100:00100000:0.0:1788581648.009477:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184307328 00000100:00100000:0.0:1788581648.009491:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184307456 00000100:00100000:0.0:1788581648.009493:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184307456 00000100:00100000:0.0:1788581648.009499:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184307968 00000100:00100000:0.0:1788581648.009502:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184307968 00000100:00100000:0.0:1788581648.009511:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581648.009525:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1875463184307328:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788581648.009549:0:24133:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:0.0:1788581648.009591:0:24133:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b318e4 00002000:00100000:0.0:1788581648.009605:0:24133:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff995d438fd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788581648.009609:0:24133:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788581648.009612:0:24133:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788581648.009679:0:24133:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788581648.009701:0:24133:0:(import.c:65:import_set_state_nolock()) ffff995d438f9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581648.009737:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1875463184307328:12345-0@lo:8:kworker.0 Request processed in 211us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581648.009881:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581648.009897:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788581648.009901:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1875463184307456:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788581648.009930:0:24133:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:0.0:1788581648.009952:0:24133:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50f0cc74b7b318eb 00002000:00100000:0.0:1788581648.009959:0:24133:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff995d438fb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788581648.009962:0:24133:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788581648.009964:0:24133:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788581648.010096:0:24133:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788581648.010110:0:24133:0:(import.c:65:import_set_state_nolock()) ffff995d438fe800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581648.010141:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1875463184307456:12345-0@lo:8:kworker.0 Request processed in 238us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581648.010147:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788581648.010161:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788581648.010165:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1875463184307968:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788581648.010200:0:24133:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:0.0:1788581648.010216:0:24133:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50f0cc74b7b318f2 00002000:00100000:0.0:1788581648.010222:0:24133:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff995d438fe000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788581648.010225:0:24133:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788581648.010227:0:24133:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788581648.010249:0:24133:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788581648.010285:0:24133:0:(import.c:65:import_set_state_nolock()) ffff995d438f8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581648.010313:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1875463184307968:12345-0@lo:8:kworker.0 Request processed in 147us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581648.010320:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788581648.010356:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6face300 x1875463184307328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581648.010365:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788581648.010372:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788581648.010380:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788581648.010384:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788581648.010387:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e4eb3a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788581648.010403:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788581648.010408:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6face300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184307328:0@lo:8:kworker.0 00010000:00080000:0.0:1788581648.010419:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facf100 x1875463184307456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581648.010425:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788581648.010429:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788581648.010433:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788581648.010436:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788581648.010444:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e48649800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788581648.010455:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788581648.010459:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875463184307456:0@lo:8:kworker.0 00010000:00080000:0.0:1788581648.010470:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facd180 x1875463184307968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788581648.010479:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788581648.010483:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788581648.010485:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788581648.010487:0:3617:0:(import.c:65:import_set_state_nolock()) ffff995e6f8e2800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788581648.010496:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788581648.010499:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875463184307968:0@lo:8:kworker.0 00000004:00080000:0.0:1788581648.010546:0:22653:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1788581648.010562:0:22653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22653:1875463184308864:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788581648.010711:0:22653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581648.010728:0:22653:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7b13f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581648.010929:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184308864 00000100:00100000:0.0:1788581648.010935:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184308864 00000100:00100000:0.0:1788581648.010973:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788581648.010982:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22653:x1875463184308864:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1788581648.011189:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581648.011280:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184307200:0@lo:400:kworker.0 00010000:00080000:0.0:1788581648.011940:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facdc00 x1875463184308096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581648.011953:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184308096:0@lo:400:kworker.0 00010000:00080000:0.0:1788581648.011963:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facdf80 x1875463184308608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581648.011981:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184308608:0@lo:400:kworker.0 00000100:00100000:0.0:1788581648.011993:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a361c037-f8ee-420d-b76d-dbdb9328e15d:3618:1875463184307072:0@lo:400:kworker.0 00010000:00080000:0.0:1788581648.012003:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6faced80 x1875463184307840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581648.012011:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184307840:0@lo:400:kworker.0 00010000:00080000:0.0:1788581648.012021:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facf480 x1875463184308480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581648.012028:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184308480:0@lo:400:kworker.0 00002000:00080000:0.0:1788581648.013406:0:24133:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788581648.013415:0:24133:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788581648.013420:0:24133:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000100:00100000:1.0:1788581648.013577:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788581648.013786:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184307712:0@lo:400:kworker.0 00010000:00080000:1.0:1788581648.013805:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facc380 x1875463184308352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581648.013816:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184308352:0@lo:400:kworker.0 00000100:00100000:1.0:1788581648.013839:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581648.013850:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184308736:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788581648.013853:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995e6facce00 x1875463184308224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581648.013867:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184308224:0@lo:400:kworker.0 00000004:00080000:2.0:1788581648.013898:0:22652:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788581648.013908:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788581648.013985:0:22652:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 634155729439ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788581648.013985:0:22651:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00080000:00080000:2.0:1788581648.013996:0:22652:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788581648.014009:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22651:1875463184309120:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788581648.014023:0:23370:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788581648.014063:0:23370:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 634155808461ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788581648.014068:0:23370:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788581648.014092:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184308736 00000100:00100000:1.0:1788581648.014098:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581648.014099:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184308736 00000100:00100000:1.0:1788581648.014116:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a639780 going to sleep for 11 seconds 00000100:00100000:2.0:1788581648.014141:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581648.014152:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875463184308736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581648.014187:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788581648.014235:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875463184308736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581648.014241:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581648.015141:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184308992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581648.015194:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788581648.015242:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43a95880 x1875463184308736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581648.015283:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184308736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581648.015313:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184309120 00000100:00100000:1.0:1788581648.015318:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184309120 00000100:00100000:1.0:1788581648.015358:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581648.015366:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22651:x1875463184309120:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788581648.017042:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184308992 00000100:00100000:2.0:1788581648.017052:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184308992 00000100:00100000:2.0:1788581648.017080:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581648.017093:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875463184308992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581648.017118:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788581648.017222:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875463184308992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581648.017229:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788581648.017906:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432c9c00 x1875463184308992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581648.017927:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184308992:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788581648.017954:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788581648.018481:0:22650:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788581648.018558:0:22650:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 634160303013ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788581648.018564:0:22650:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788581648.020301:0:23371:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788581648.020329:0:23371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23371:1875463184309376:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788581648.021642:0:23371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581648.021675:0:23371:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e4f268d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581648.021727:0:24134:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788581648.021735:0:24134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788581648.021809:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581648.021825:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184309248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581648.021855:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581648.022191:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184309376 00000100:00100000:3.0:1788581648.022199:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184309376 00000100:00100000:3.0:1788581648.022336:0:25026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788581648.022346:0:25026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23371:x1875463184309376:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:1.0:1788581648.022550:0:24131:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788581648.022558:0:24131:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1788581648.022563:0:24131:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00000100:00100000:2.0:1788581648.024703:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184309248 00000100:00100000:2.0:1788581648.024713:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184309248 00000100:00100000:2.0:1788581648.026387:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788581648.026405:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3619:x1875463184309248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788581648.026431:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788581648.026525:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3619:x1875463184309248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (4667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581648.026533:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788581648.026562:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43835180 x1875463184309248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581648.026587:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184309248:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1788581648.027873:0:23359:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1788581648.027912:0:22607:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00080000:0.0:1788581648.039561:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1788581648.047468:0:25026:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788581648.047478:0:25026:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788581648.047572:0:25026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23371:x1875463184309376:12345-0@lo:7:osp-pre-1-1.0 Request processed in 25222us (25929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581648.047584:0:25026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788581648.047642:0:23371:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d44071c00 x1875463184309376/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788581664 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581648.047656:0:23371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23371:1875463184309376:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788581648.047741:0:23371:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788581648.047784:0:23371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23371:1875463184309504:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788581648.047818:0:23371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581648.047841:0:23371:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44eeec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581648.047867:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184309504 00000100:00100000:3.0:1788581648.047873:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184309504 00000100:00100000:3.0:1788581648.047916:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788581648.047926:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23371:x1875463184309504:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788581648.047950:0:24134:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788581648.047983:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23371:x1875463184309504:12345-0@lo:5:osp-pre-1-1.0 Request processed in 58us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581648.047989:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788581648.048018:0:23371:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d44071c00 x1875463184309504/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581664 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581648.048029:0:23371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23371:1875463184309504:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788581648.048039:0:23371:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788581648.048063:0:23371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23371:1875463184309632:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788581648.048224:0:23371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581648.048241:0:23371:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e44eeec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581648.048273:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184309632 00000100:00100000:3.0:1788581648.048277:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184309632 00000100:00100000:3.0:1788581648.048300:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788581648.048366:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23371:x1875463184309632:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788581648.048460:0:24134:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:0.0:1788581648.056272:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581648.056286:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008711c900/0x50f0cc74b7b318f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.056302:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1788581648.056308:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581648.056314:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008711c900/0x50f0cc74b7b318f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.056334:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008711c900/0x50f0cc74b7b318f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.056361:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008711c900/0x50f0cc74b7b318f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.056369:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008711c900/0x50f0cc74b7b318f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.056388:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581648.056812:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.056820:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008711c900/0x50f0cc74b7b318f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.056830:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.056834:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008711c900/0x50f0cc74b7b318f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.056843:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008711c900/0x50f0cc74b7b318f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.056873:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008711c900/0x50f0cc74b7b318f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.056881:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008711c900/0x50f0cc74b7b318f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.056898:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.056900:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.056902:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581648.057111:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581648.057117:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c50e57f7/0x50f0cc74b7b31900 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.057126:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1788581648.057129:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581648.057134:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c50e57f7/0x50f0cc74b7b31900 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.057143:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c50e57f7/0x50f0cc74b7b31900 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.057151:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c50e57f7/0x50f0cc74b7b31900 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.057158:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c50e57f7/0x50f0cc74b7b31900 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.057194:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581648.057203:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581648.057207:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c50e57f7/0x50f0cc74b7b31900 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.057215:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43273800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.057219:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50e57f7/0x50f0cc74b7b31900 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.057228:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50e57f7/0x50f0cc74b7b31900 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.057241:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c50e57f7/0x50f0cc74b7b31900 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.057248:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c50e57f7/0x50f0cc74b7b31900 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.057282:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.057284:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.057286:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581648.059411:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581648.059424:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b31907 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.059439:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1788581648.059450:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581648.059456:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b31907 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.059470:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b31907 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.059479:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b31907 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.059486:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b31907 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.059505:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581648.059681:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.059688:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b31907 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.059697:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.059702:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b31907 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.059712:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b31907 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.059729:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b31907 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.059737:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c64e6ba/0x50f0cc74b7b31907 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.059766:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.059768:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.059770:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581648.061564:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581648.061576:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b3190e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.061590:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1788581648.061595:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581648.061600:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b3190e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.061613:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b3190e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.061623:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b3190e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.061638:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b3190e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.061655:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581648.061666:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581648.061671:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b3190e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.061679:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43273200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.061683:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b3190e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.061693:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b3190e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.061708:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b3190e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.061716:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d77484c0/0x50f0cc74b7b3190e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.061733:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.061735:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.061737:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581648.062170:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581648.062873:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b31915 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.062885:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1788581648.062889:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581648.062894:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b31915 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.062905:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b31915 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.062914:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b31915 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.062922:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b31915 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.062938:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581648.062992:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.062999:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b31915 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.063010:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.063014:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b31915 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.063023:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b31915 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.063036:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b31915 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.063043:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d4c1bb7/0x50f0cc74b7b31915 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.063060:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.063062:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.063063:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581648.063123:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581648.063129:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000148e4a68/0x50f0cc74b7b3191c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.063149:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=634s v=(0 0) 00010000:00010000:1.0:1788581648.063153:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581648.063158:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000148e4a68/0x50f0cc74b7b3191c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.063181:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000148e4a68/0x50f0cc74b7b3191c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.063190:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000148e4a68/0x50f0cc74b7b3191c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.063198:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000148e4a68/0x50f0cc74b7b3191c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.063224:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581648.063234:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.063238:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000148e4a68/0x50f0cc74b7b3191c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.063245:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccba00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.063248:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000148e4a68/0x50f0cc74b7b3191c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.063288:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000148e4a68/0x50f0cc74b7b3191c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.063314:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000148e4a68/0x50f0cc74b7b3191c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.063321:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000148e4a68/0x50f0cc74b7b3191c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.063342:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.063345:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.063348:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581648.064473:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581648.064483:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31923 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.064495:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=634s v=(0 0) 00010000:00010000:1.0:1788581648.064499:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581648.064505:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31923 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.064516:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31923 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.064525:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31923 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.064548:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31923 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.064646:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581648.064655:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.064659:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31923 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.064668:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccb200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.064673:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31923 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788581648.064674:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581648.064686:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bc7613c/0x50f0cc74b7b3192a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.064687:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31923 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.064701:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1788581648.064710:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581648.064715:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bc7613c/0x50f0cc74b7b3192a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.064719:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31923 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.064746:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31923 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.064759:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.064761:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.064762:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.064910:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bc7613c/0x50f0cc74b7b3192a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.064974:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bc7613c/0x50f0cc74b7b3192a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.064982:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bc7613c/0x50f0cc74b7b3192a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.065003:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788581648.065329:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581648.065335:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000018f86e0/0x50f0cc74b7b31931 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.065344:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1788581648.065348:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581648.065352:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000018f86e0/0x50f0cc74b7b31931 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.065360:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000018f86e0/0x50f0cc74b7b31931 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.065368:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000018f86e0/0x50f0cc74b7b31931 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.065375:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000018f86e0/0x50f0cc74b7b31931 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.065403:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788581648.065420:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581648.065427:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bc7613c/0x50f0cc74b7b3192a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065436:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.065446:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bc7613c/0x50f0cc74b7b3192a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065456:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bc7613c/0x50f0cc74b7b3192a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065469:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bc7613c/0x50f0cc74b7b3192a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065476:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bc7613c/0x50f0cc74b7b3192a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065491:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.065495:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000018f86e0/0x50f0cc74b7b31931 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065501:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.065505:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000018f86e0/0x50f0cc74b7b31931 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065513:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000018f86e0/0x50f0cc74b7b31931 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065523:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000018f86e0/0x50f0cc74b7b31931 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065529:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000018f86e0/0x50f0cc74b7b31931 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065549:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.065551:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.065553:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.065559:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581648.065668:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581648.065674:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea473ee/0x50f0cc74b7b31938 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065683:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=634s v=(0 0) 00010000:00010000:1.0:1788581648.065686:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581648.065690:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea473ee/0x50f0cc74b7b31938 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065699:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea473ee/0x50f0cc74b7b31938 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065707:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea473ee/0x50f0cc74b7b31938 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065714:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea473ee/0x50f0cc74b7b31938 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065728:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581648.065735:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.065739:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea473ee/0x50f0cc74b7b31938 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065774:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccb800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.065779:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea473ee/0x50f0cc74b7b31938 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065785:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea473ee/0x50f0cc74b7b31938 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065796:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea473ee/0x50f0cc74b7b31938 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065804:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea473ee/0x50f0cc74b7b31938 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.065817:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.065819:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.065821:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581648.066674:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581648.066681:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3193f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.066692:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=634s v=(0 0) 00010000:00010000:1.0:1788581648.066696:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581648.066701:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3193f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.066712:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3193f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.066743:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3193f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.066749:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3193f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.066822:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581648.066830:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.066834:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3193f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.066842:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42cca200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.066846:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3193f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.066854:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3193f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.066867:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3193f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.066874:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3193f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788581648.067383:0:22607:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788581648.068704:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581648.068715:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000817bf946/0x50f0cc74b7b31946 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.068730:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1788581648.068734:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581648.068888:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.068898:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.068900:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.070014:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000817bf946/0x50f0cc74b7b31946 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.070035:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000817bf946/0x50f0cc74b7b31946 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.070046:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000817bf946/0x50f0cc74b7b31946 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.070054:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000817bf946/0x50f0cc74b7b31946 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.070079:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581648.070204:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.070272:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000817bf946/0x50f0cc74b7b31946 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.070282:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71c00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.070287:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000817bf946/0x50f0cc74b7b31946 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.070295:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000817bf946/0x50f0cc74b7b31946 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.070313:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000817bf946/0x50f0cc74b7b31946 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.070320:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000817bf946/0x50f0cc74b7b31946 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.070342:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.070344:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.070346:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581648.074334:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581648.074345:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3194d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.074361:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=634s v=(0 0) 00010000:00010000:1.0:1788581648.074366:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581648.074728:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3194d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.074744:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3194d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.074753:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3194d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.074760:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3194d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.074777:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581648.074945:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.074951:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3194d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.074960:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42cca200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.074965:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3194d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.074973:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3194d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.074991:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3194d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.075009:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b3194d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.075026:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.075028:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.075030:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581648.075341:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581648.075347:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea473ee/0x50f0cc74b7b31954 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.075355:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=634s v=(0 0) 00010000:00010000:1.0:1788581648.075359:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581648.075363:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea473ee/0x50f0cc74b7b31954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.075569:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea473ee/0x50f0cc74b7b31954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.075580:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea473ee/0x50f0cc74b7b31954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.075650:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea473ee/0x50f0cc74b7b31954 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.075667:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581648.075677:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.075687:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea473ee/0x50f0cc74b7b31954 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.075694:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccb800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.075698:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea473ee/0x50f0cc74b7b31954 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.075706:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea473ee/0x50f0cc74b7b31954 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.075719:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea473ee/0x50f0cc74b7b31954 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.075726:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea473ee/0x50f0cc74b7b31954 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.075745:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.075747:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.075749:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581648.077461:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581648.077473:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b3195b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.077489:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.077493:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581648.077499:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b3195b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.077513:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b3195b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.077534:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b3195b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.077541:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b3195b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.077565:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581648.077689:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.077696:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b3195b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.077706:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.077710:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b3195b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.077731:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b3195b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.077745:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b3195b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.077752:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b3195b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.077767:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.077768:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.077770:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581648.079094:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581648.079105:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b31962 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.079120:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.079125:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581648.079131:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b31962 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.079144:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b31962 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.079153:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b31962 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.079161:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b31962 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.079206:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581648.079295:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.079302:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b31962 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.079310:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0ea00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.079315:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b31962 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.079324:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b31962 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.079338:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b31962 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.079356:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a34935bd/0x50f0cc74b7b31962 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.079369:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.079379:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.079381:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581648.080367:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581648.080376:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31969 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.080388:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.080393:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581648.080398:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31969 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.080409:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31969 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.080418:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31969 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.080426:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31969 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.080447:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581648.080468:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.080474:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31969 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.080491:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.080495:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31969 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.080503:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31969 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.080517:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31969 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.080524:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31969 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.080541:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.080543:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.080545:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581648.081151:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.081160:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b31970 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.081182:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.081187:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.081198:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b31970 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.081305:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b31970 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.081315:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b31970 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.081323:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b31970 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.081340:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788581648.081734:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.081740:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31977 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.081748:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.081752:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.081756:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31977 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.081765:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31977 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.081772:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31977 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.081790:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31977 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.081807:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788581648.081836:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581648.081843:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b31970 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.081851:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.081855:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b31970 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.081862:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b31970 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.081875:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b31970 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.081883:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008379cfc2/0x50f0cc74b7b31970 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.081901:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.081904:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31977 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.081912:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.081914:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31977 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.081922:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31977 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.081944:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31977 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.081950:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006256d191/0x50f0cc74b7b31977 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.081962:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.081964:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.081966:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.081972:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581648.082109:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.082116:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b3197e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.082187:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.082191:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.082196:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b3197e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.082207:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b3197e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.082215:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b3197e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.082221:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b3197e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.082239:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581648.082337:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.082343:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b3197e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.082350:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.082354:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b3197e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.082362:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b3197e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.082440:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b3197e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.082448:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b3197e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.082475:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.082477:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.082479:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581648.082744:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.082750:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000683bd872/0x50f0cc74b7b31985 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.082765:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.082768:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.082772:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000683bd872/0x50f0cc74b7b31985 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.082781:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000683bd872/0x50f0cc74b7b31985 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.082789:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000683bd872/0x50f0cc74b7b31985 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.082796:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000683bd872/0x50f0cc74b7b31985 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.082816:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581648.082881:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.082886:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000683bd872/0x50f0cc74b7b31985 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.082894:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6ae00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.082898:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000683bd872/0x50f0cc74b7b31985 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.082906:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000683bd872/0x50f0cc74b7b31985 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.082917:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000683bd872/0x50f0cc74b7b31985 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.082924:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000683bd872/0x50f0cc74b7b31985 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.082938:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.082939:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.082941:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581648.083065:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.083071:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b3198c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.083078:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.083080:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.083084:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b3198c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.083092:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b3198c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.083111:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b3198c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.083117:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b3198c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.083213:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788581648.083401:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581648.083409:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31993 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.083419:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.083428:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581648.083433:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31993 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.083444:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31993 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.083451:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31993 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.083458:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31993 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.083469:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788581648.083915:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581648.083921:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b3198c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.083940:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6b400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.083944:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b3198c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.083952:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b3198c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.083965:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b3198c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.083971:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000337542f4/0x50f0cc74b7b3198c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.083986:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.083990:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31993 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.083996:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.083999:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31993 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.084006:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31993 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.084016:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31993 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.084030:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31993 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.084044:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.084046:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.084048:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.084054:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581648.084706:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.084714:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b3199a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.084725:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.084729:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.084733:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b3199a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.084743:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b3199a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.084752:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b3199a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.084759:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b3199a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.084788:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581648.084957:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.084963:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b3199a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.084972:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.084975:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b3199a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.084983:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b3199a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.084996:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b3199a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.085003:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028b739b6/0x50f0cc74b7b3199a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.085017:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.085018:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.085026:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581648.085518:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.085525:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2d1250b/0x50f0cc74b7b319a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.085534:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.085537:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.085541:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d1250b/0x50f0cc74b7b319a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.085550:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2d1250b/0x50f0cc74b7b319a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.085559:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2d1250b/0x50f0cc74b7b319a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.085565:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d1250b/0x50f0cc74b7b319a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.085662:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581648.085892:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.085899:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2d1250b/0x50f0cc74b7b319a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.085907:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.085911:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2d1250b/0x50f0cc74b7b319a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.085919:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2d1250b/0x50f0cc74b7b319a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.085932:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2d1250b/0x50f0cc74b7b319a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.085939:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2d1250b/0x50f0cc74b7b319a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.085955:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.085957:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.085959:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581648.086034:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.086040:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b319a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.086048:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.086058:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.086062:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b319a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.086072:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b319a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788581648.086078:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.086081:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b319a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.086088:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b319af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.086092:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b319a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.086112:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.086118:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581648.086123:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b319af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.086133:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b319af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.086142:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b319af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.086157:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b319af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.086507:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788581648.086576:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788581648.086832:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.086839:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b319b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.086848:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.086852:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.086856:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b319b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.086865:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b319b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.086873:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b319b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.086887:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b319b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.086896:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788581648.087062:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788581648.087069:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b319a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087078:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.087089:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b319a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087097:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b319a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087113:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b319a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087119:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d75f9ad9/0x50f0cc74b7b319a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581648.087193:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.087199:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eb0cb37/0x50f0cc74b7b319bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.087209:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.087212:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.087216:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007eb0cb37/0x50f0cc74b7b319bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.087235:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007eb0cb37/0x50f0cc74b7b319bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.087245:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eb0cb37/0x50f0cc74b7b319bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087250:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581648.087276:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007eb0cb37/0x50f0cc74b7b319bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087285:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b319af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.087291:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788581648.087295:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.087300:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b319af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087308:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b319af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087320:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b319af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788581648.087334:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581648.087341:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b319c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.087350:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.087354:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581648.087358:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b319c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.087368:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b319c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.087377:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b319c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.087384:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b319c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.087394:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788581648.087396:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b319af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087417:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788581648.087422:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b319b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087499:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.087504:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b319b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087512:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b319b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087589:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b319b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087597:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028b10c3f/0x50f0cc74b7b319b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087610:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581648.087613:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007eb0cb37/0x50f0cc74b7b319bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087619:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980a00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.087622:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007eb0cb37/0x50f0cc74b7b319bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087641:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007eb0cb37/0x50f0cc74b7b319bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087651:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007eb0cb37/0x50f0cc74b7b319bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087657:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007eb0cb37/0x50f0cc74b7b319bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087669:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581648.087672:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b319c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087678:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.087681:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b319c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087688:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b319c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087696:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b319c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087703:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b319c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.087725:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.087727:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.087729:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581648.087816:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.087823:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006903b303/0x50f0cc74b7b319cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.087837:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.087840:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.087845:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006903b303/0x50f0cc74b7b319cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.087854:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006903b303/0x50f0cc74b7b319cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.087862:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006903b303/0x50f0cc74b7b319cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.087868:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006903b303/0x50f0cc74b7b319cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.087886:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788581648.088151:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.088157:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005396b425/0x50f0cc74b7b319d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.088164:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.088167:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.088180:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005396b425/0x50f0cc74b7b319d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.088189:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005396b425/0x50f0cc74b7b319d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.088208:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005396b425/0x50f0cc74b7b319d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.088214:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005396b425/0x50f0cc74b7b319d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.088223:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788581648.088828:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.088835:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b319d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.088845:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.088848:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.088852:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b319d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.088861:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b319d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.088869:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b319d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.088876:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b319d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.088896:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788581648.089235:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.089241:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ccb9ce6/0x50f0cc74b7b319e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.089250:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.089280:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.089284:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ccb9ce6/0x50f0cc74b7b319e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.089294:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ccb9ce6/0x50f0cc74b7b319e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.089303:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ccb9ce6/0x50f0cc74b7b319e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.089310:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ccb9ce6/0x50f0cc74b7b319e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.089320:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788581648.089517:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788581648.089524:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006903b303/0x50f0cc74b7b319cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.089532:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.089536:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006903b303/0x50f0cc74b7b319cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.089557:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006903b303/0x50f0cc74b7b319cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.089571:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006903b303/0x50f0cc74b7b319cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.089577:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006903b303/0x50f0cc74b7b319cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.089594:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788581648.089598:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005396b425/0x50f0cc74b7b319d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581648.089831:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.089838:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b319e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.089846:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.089855:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.089860:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b319e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.089869:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b319e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.089876:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b319e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.089884:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b319e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.089893:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788581648.090023:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981c00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.090028:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005396b425/0x50f0cc74b7b319d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.090038:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005396b425/0x50f0cc74b7b319d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.090050:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005396b425/0x50f0cc74b7b319d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.090058:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005396b425/0x50f0cc74b7b319d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090085:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788581648.090088:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788581648.090094:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b319d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090110:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581648.090114:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b319d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090122:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b319d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090136:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b319d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090143:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002e2c2d9/0x50f0cc74b7b319d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090159:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581648.090163:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b319e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090168:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980c00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581648.090181:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b319e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090188:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b319e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090197:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b319e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090210:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000441c4b42/0x50f0cc74b7b319e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090222:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581648.090223:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581648.090225:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581648.090287:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581648.090293:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b319ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090301:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.090305:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581648.090309:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b319ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090318:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b319ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090326:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b319ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090352:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b319ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090431:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581648.090439:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581648.090449:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b319ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090456:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0ec00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581648.090460:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b319ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090467:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b319ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090478:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b319ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090485:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b319ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.090499:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581648.090500:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581648.090502:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581648.090761:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.090767:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b319f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.090776:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.090779:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.090783:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b319f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.090792:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b319f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.090801:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b319f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.090814:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b319f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.090835:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581648.092344:0:25028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581648.092352:0:25028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b319f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.092362:0:25028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.092367:0:25028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b319f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.092376:0:25028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b319f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581648.092590:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.092598:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000392d415b/0x50f0cc74b7b319fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.092608:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.092613:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.092619:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000392d415b/0x50f0cc74b7b319fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.092631:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000392d415b/0x50f0cc74b7b319fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.092639:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000392d415b/0x50f0cc74b7b319fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.092648:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000392d415b/0x50f0cc74b7b319fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.092659:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581648.092833:0:25028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b319f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.092843:0:25028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007936de09/0x50f0cc74b7b319f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.092866:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ccb9ce6/0x50f0cc74b7b319e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.092872:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.092875:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ccb9ce6/0x50f0cc74b7b319e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.092890:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ccb9ce6/0x50f0cc74b7b319e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.092901:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ccb9ce6/0x50f0cc74b7b319e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.092909:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ccb9ce6/0x50f0cc74b7b319e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.092922:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581648.092925:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000392d415b/0x50f0cc74b7b319fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.092930:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980e00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.092933:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000392d415b/0x50f0cc74b7b319fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.092940:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000392d415b/0x50f0cc74b7b319fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.092949:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000392d415b/0x50f0cc74b7b319fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.092956:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000392d415b/0x50f0cc74b7b319fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.092981:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.092983:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.092985:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.092991:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.092993:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.092994:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.093325:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581648.093522:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.093529:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31a03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.093543:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.093547:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.093552:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31a03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.093564:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31a03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.093573:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31a03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.093581:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31a03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.093633:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788581648.094283:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.094291:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b31a0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.094300:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.094303:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.094308:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b31a0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.094318:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b31a0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.094337:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b31a0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.094345:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b31a0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.098033:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581648.098046:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31a03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.098059:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.098064:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31a03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.098074:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31a03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.098094:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31a03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.098102:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31a03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.098121:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581648.098125:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b31a0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.098142:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981a00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.098145:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b31a0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.098154:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b31a0a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.098166:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b31a0a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.098185:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.098186:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.098188:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.098626:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581648.098818:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788581648.098827:0:24131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f49cde10/0x50f0cc74b7b31a0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788581648.098844:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581648.098854:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b31a11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.098867:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.098872:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581648.098878:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b31a11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.098908:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b31a11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.098919:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b31a11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.098927:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b31a11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.098945:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788581648.099426:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581648.099432:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b31a18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581648.099435:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.099447:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e10809a/0x50f0cc74b7b31a1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.099447:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.099456:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.099466:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.099466:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b31a18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.099473:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.099484:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e10809a/0x50f0cc74b7b31a1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.099487:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b31a18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.099509:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e10809a/0x50f0cc74b7b31a1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.099510:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b31a18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.099531:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e10809a/0x50f0cc74b7b31a1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.099549:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b31a18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.099563:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e10809a/0x50f0cc74b7b31a1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.099575:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788581648.099582:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788581648.099671:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788581648.099677:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b31a11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.099686:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.099690:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b31a11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.099699:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b31a11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.099713:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b31a11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.099729:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008994818f/0x50f0cc74b7b31a11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.099744:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581648.099748:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b31a18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.099755:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.099758:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b31a18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.099766:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b31a18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.099777:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b31a18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.099785:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9059076/0x50f0cc74b7b31a18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.099798:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581648.099802:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e10809a/0x50f0cc74b7b31a1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.099808:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.099817:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e10809a/0x50f0cc74b7b31a1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.099824:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e10809a/0x50f0cc74b7b31a1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.099918:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e10809a/0x50f0cc74b7b31a1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.099926:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e10809a/0x50f0cc74b7b31a1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.099968:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.099971:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.099972:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.099976:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.099981:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581648.100081:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581648.100088:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31a26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.100097:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.100100:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581648.100104:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31a26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.100113:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31a26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.100120:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31a26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.100126:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31a26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581648.100131:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788581648.100139:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058f82efa/0x50f0cc74b7b31a2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.100143:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581648.100148:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1788581648.100152:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581648.100156:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058f82efa/0x50f0cc74b7b31a2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.100167:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058f82efa/0x50f0cc74b7b31a2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.100183:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058f82efa/0x50f0cc74b7b31a2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.100190:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058f82efa/0x50f0cc74b7b31a2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.100207:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788581648.100214:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581648.100218:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31a26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.100232:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581648.100236:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31a26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.100244:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31a26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.100272:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31a26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.100280:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b63c1f41/0x50f0cc74b7b31a26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.100293:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581648.100296:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058f82efa/0x50f0cc74b7b31a2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.100302:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981e00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581648.100305:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058f82efa/0x50f0cc74b7b31a2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.100312:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058f82efa/0x50f0cc74b7b31a2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.100321:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058f82efa/0x50f0cc74b7b31a2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.100334:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058f82efa/0x50f0cc74b7b31a2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.100346:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581648.100348:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581648.100350:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.100620:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581648.101470:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581648.101479:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31a34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788581648.101496:0:24948:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00010000:00010000:2.0:1788581648.101497:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.101505:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581648.101510:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31a34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.101521:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31a34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788581648.101528:0:24948:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:2.0:1788581648.101531:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31a34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788581648.101534:0:24948:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788581648.101543:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31a34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.101562:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788581648.101691:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23371:x1875463184309632:12345-0@lo:5:osp-pre-1-1.0 Request processed in 53380us (53462us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788581648.101701:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788581648.101729:0:25028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581648.101734:0:25028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31a34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.101753:0:25028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.101757:0:25028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31a34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.101764:0:25028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31a34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.101778:0:25028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31a34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.101785:0:25028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000278cd532/0x50f0cc74b7b31a34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.101801:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.101803:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.101805:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581648.102119:0:23371:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788581648.102209:0:23371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23371:1875463184309632:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788581648.102228:0:23371:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1788581648.102302:0:23371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23371:1875463184309760:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1788581648.102303:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581648.102313:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a34935bd/0x50f0cc74b7b31a3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.102323:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.102327:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581648.102332:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a34935bd/0x50f0cc74b7b31a3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.102344:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a34935bd/0x50f0cc74b7b31a3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581648.102348:0:23371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581648.102370:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a34935bd/0x50f0cc74b7b31a3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581648.102375:0:23371:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d422aab40 going to sleep for 11 seconds 00010000:00010000:2.0:1788581648.102380:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a34935bd/0x50f0cc74b7b31a3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788581648.102512:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581648.102518:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc5dae83/0x50f0cc74b7b31a42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.102527:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1788581648.102531:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581648.102535:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc5dae83/0x50f0cc74b7b31a42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.102545:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc5dae83/0x50f0cc74b7b31a42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.102559:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc5dae83/0x50f0cc74b7b31a42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.102566:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc5dae83/0x50f0cc74b7b31a42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581648.102662:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184309760 00000100:00100000:3.0:1788581648.102669:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184309760 00010000:00010000:2.0:1788581648.102981:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788581648.103612:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788581648.104240:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788581648.104249:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a34935bd/0x50f0cc74b7b31a3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.104313:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0ea00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581648.104319:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a34935bd/0x50f0cc74b7b31a3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.104328:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a34935bd/0x50f0cc74b7b31a3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.104346:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a34935bd/0x50f0cc74b7b31a3b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.104353:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a34935bd/0x50f0cc74b7b31a3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.104370:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581648.104383:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc5dae83/0x50f0cc74b7b31a42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.104400:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70e00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581648.104404:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc5dae83/0x50f0cc74b7b31a42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.104412:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc5dae83/0x50f0cc74b7b31a42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.104423:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc5dae83/0x50f0cc74b7b31a42 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.104430:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc5dae83/0x50f0cc74b7b31a42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.104444:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581648.104446:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581648.104448:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581648.105311:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581648.105320:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080fd5439/0x50f0cc74b7b31a49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.105333:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1788581648.105337:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581648.105343:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080fd5439/0x50f0cc74b7b31a49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.105353:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080fd5439/0x50f0cc74b7b31a49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.105361:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080fd5439/0x50f0cc74b7b31a49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.105368:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080fd5439/0x50f0cc74b7b31a49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.105405:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581648.105579:0:25028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581648.105585:0:25028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080fd5439/0x50f0cc74b7b31a49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.105593:0:25028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.105598:0:25028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080fd5439/0x50f0cc74b7b31a49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.105611:0:25028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080fd5439/0x50f0cc74b7b31a49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.105624:0:25028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080fd5439/0x50f0cc74b7b31a49 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.105632:0:25028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080fd5439/0x50f0cc74b7b31a49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.105649:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.105651:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.105652:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581648.105710:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788581648.105736:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23371:x1875463184309760:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788581648.105838:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23371:x1875463184309760:12345-0@lo:900:osp-pre-1-1.0 Request processed in 107us (3492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581648.105846:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788581648.105873:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788581648.105954:0:23371:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d44071c00 x1875463184309760/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788581664 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581648.105969:0:23371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23371:1875463184309760:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1788581648.106035:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581648.106047:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041bc75c3/0x50f0cc74b7b31a50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.106057:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1788581648.106060:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581648.106065:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041bc75c3/0x50f0cc74b7b31a50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.106075:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041bc75c3/0x50f0cc74b7b31a50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.106084:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041bc75c3/0x50f0cc74b7b31a50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.106091:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041bc75c3/0x50f0cc74b7b31a50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.106111:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788581648.106511:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581648.106517:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013eeada0/0x50f0cc74b7b31a57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.106525:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1788581648.106528:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581648.106532:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013eeada0/0x50f0cc74b7b31a57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.106541:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013eeada0/0x50f0cc74b7b31a57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.106557:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013eeada0/0x50f0cc74b7b31a57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.106563:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013eeada0/0x50f0cc74b7b31a57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.106577:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788581648.106737:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581648.106743:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b31a5e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.106752:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.106755:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581648.106758:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b31a5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.106779:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b31a5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.106788:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b31a5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.106795:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b31a5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.106807:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788581648.106886:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788581648.106894:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041bc75c3/0x50f0cc74b7b31a50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.106903:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581648.106914:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041bc75c3/0x50f0cc74b7b31a50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.106923:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041bc75c3/0x50f0cc74b7b31a50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.106936:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041bc75c3/0x50f0cc74b7b31a50 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.106944:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041bc75c3/0x50f0cc74b7b31a50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.106971:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581648.106975:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013eeada0/0x50f0cc74b7b31a57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.106990:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581648.106994:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013eeada0/0x50f0cc74b7b31a57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.107008:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013eeada0/0x50f0cc74b7b31a57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.107018:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013eeada0/0x50f0cc74b7b31a57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.107025:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013eeada0/0x50f0cc74b7b31a57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.107056:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581648.107060:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b31a5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788581648.107523:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581648.107530:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0d362f8/0x50f0cc74b7b31a65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.107540:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1788581648.107543:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581648.107548:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0d362f8/0x50f0cc74b7b31a65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.107559:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0ec00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.107563:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0d362f8/0x50f0cc74b7b31a65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.107565:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b31a5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.107577:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0d362f8/0x50f0cc74b7b31a65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.107584:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0d362f8/0x50f0cc74b7b31a65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.107653:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b31a5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.107667:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b31a5e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.107682:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1a62e88/0x50f0cc74b7b31a5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.107698:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581648.107700:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581648.107702:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581648.107710:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581648.107775:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581648.107781:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b31a6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.107789:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.107792:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581648.107796:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b31a6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.107805:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b31a6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.107812:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b31a6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.107830:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b31a6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.107846:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581648.107927:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581648.107933:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b31a6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.107941:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e000 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581648.107961:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b31a6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.107970:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b31a6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.107989:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b31a6c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.108003:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059b081c7/0x50f0cc74b7b31a6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.108017:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581648.108019:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581648.108020:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.108222:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581648.108270:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581648.108276:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0d362f8/0x50f0cc74b7b31a65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.108285:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581648.108289:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0d362f8/0x50f0cc74b7b31a65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.108298:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0d362f8/0x50f0cc74b7b31a65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.108345:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581648.108431:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0d362f8/0x50f0cc74b7b31a65 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.108447:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0d362f8/0x50f0cc74b7b31a65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.108501:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581648.108504:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581648.108506:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581648.109237:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581648.109245:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a81d9f3/0x50f0cc74b7b31a73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.109278:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1788581648.109282:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581648.109288:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a81d9f3/0x50f0cc74b7b31a73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.109299:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a81d9f3/0x50f0cc74b7b31a73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.109308:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a81d9f3/0x50f0cc74b7b31a73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.109315:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a81d9f3/0x50f0cc74b7b31a73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.109334:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581648.109355:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581648.109362:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a81d9f3/0x50f0cc74b7b31a73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.109371:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581648.109375:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a81d9f3/0x50f0cc74b7b31a73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.109383:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a81d9f3/0x50f0cc74b7b31a73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.109397:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a81d9f3/0x50f0cc74b7b31a73 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.109405:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a81d9f3/0x50f0cc74b7b31a73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.109420:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581648.109422:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581648.109424:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581648.109512:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581648.109517:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31a7a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.109527:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.109530:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581648.109534:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31a7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.109543:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31a7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.109551:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31a7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.109557:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31a7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.109572:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581648.109802:0:25028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581648.109808:0:25028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31a7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.109816:0:25028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0fe00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.109824:0:25028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31a7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.109833:0:25028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31a7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.109844:0:25028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31a7a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.109851:0:25028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4253410/0x50f0cc74b7b31a7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.109867:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.109868:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.109870:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581648.110470:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581648.110476:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b31a81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.110485:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1788581648.110489:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581648.110493:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b31a81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.110503:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b31a81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.110512:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b31a81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.110526:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b31a81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.110541:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788581648.111366:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581648.111374:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f727510/0x50f0cc74b7b31a88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.111383:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1788581648.111386:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00002000:00010000:2.0:1788581648.111525:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581648.111531:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055d74059/0x50f0cc74b7b31a8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.111545:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.111548:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581648.111553:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055d74059/0x50f0cc74b7b31a8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.111563:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055d74059/0x50f0cc74b7b31a8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.111572:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055d74059/0x50f0cc74b7b31a8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.111580:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055d74059/0x50f0cc74b7b31a8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.111595:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788581648.111862:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f727510/0x50f0cc74b7b31a88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.111873:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f727510/0x50f0cc74b7b31a88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.111880:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f727510/0x50f0cc74b7b31a88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.111887:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f727510/0x50f0cc74b7b31a88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.111902:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788581648.112110:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788581648.112116:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a9e41a/0x50f0cc74b7b31a96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.112197:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=634s v=(0 0) 00010000:00010000:2.0:1788581648.112202:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581648.112207:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034a9e41a/0x50f0cc74b7b31a96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.112216:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034a9e41a/0x50f0cc74b7b31a96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.112235:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a9e41a/0x50f0cc74b7b31a96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.112242:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034a9e41a/0x50f0cc74b7b31a96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.112251:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788581648.112482:0:25028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788581648.112489:0:25028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b31a81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.112504:0:25028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70c00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.112508:0:25028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b31a81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.112517:0:25028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b31a81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.112532:0:25028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b31a81 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.112539:0:25028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000528954fd/0x50f0cc74b7b31a81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.112556:0:25028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788581648.112559:0:25028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055d74059/0x50f0cc74b7b31a8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.112565:0:25028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.112568:0:25028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055d74059/0x50f0cc74b7b31a8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.112575:0:25028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055d74059/0x50f0cc74b7b31a8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.112586:0:25028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055d74059/0x50f0cc74b7b31a8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.112599:0:25028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055d74059/0x50f0cc74b7b31a8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788581648.112990:0:24131:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1788581648.113082:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22651:x1875463184309120:12345-0@lo:5:osp-pre-0-0.0 Request processed in 97714us (98981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581648.113091:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581648.113280:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22651:1875463184309120:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788581648.113295:0:22651:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1788581648.113338:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22651:1875463184309888:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788581648.113374:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788581648.113508:0:25028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581648.113513:0:25028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f727510/0x50f0cc74b7b31a88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.113520:0:25028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71a00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.113524:0:25028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f727510/0x50f0cc74b7b31a88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.113530:0:25028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f727510/0x50f0cc74b7b31a88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.113543:0:25028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f727510/0x50f0cc74b7b31a88 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.113551:0:25028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f727510/0x50f0cc74b7b31a88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.113563:0:25028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581648.113566:0:25028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034a9e41a/0x50f0cc74b7b31a96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.113572:0:25028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0ee00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.113582:0:25028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a9e41a/0x50f0cc74b7b31a96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.113590:0:25028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a9e41a/0x50f0cc74b7b31a96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.113601:0:25028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034a9e41a/0x50f0cc74b7b31a96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581648.113675:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4239f540 going to sleep for 11 seconds 00010000:00010000:0.0:1788581648.113743:0:25028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034a9e41a/0x50f0cc74b7b31a96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.113759:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.113761:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.113763:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581648.113822:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788581648.113828:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098f7b5d4/0x50f0cc74b7b31a9d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.113838:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1788581648.113841:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581648.113846:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098f7b5d4/0x50f0cc74b7b31a9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.113856:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098f7b5d4/0x50f0cc74b7b31a9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.113864:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098f7b5d4/0x50f0cc74b7b31a9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.113878:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098f7b5d4/0x50f0cc74b7b31a9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.114000:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788581648.114209:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184309888 00000100:00100000:3.0:1788581648.114217:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184309888 00000100:00100000:3.0:1788581648.114284:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788581648.114294:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22651:x1875463184309888:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788581648.114343:0:24665:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:1.0:1788581648.114496:0:25028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581648.114503:0:25028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098f7b5d4/0x50f0cc74b7b31a9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.114513:0:25028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71800 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581648.114517:0:25028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098f7b5d4/0x50f0cc74b7b31a9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.114526:0:25028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098f7b5d4/0x50f0cc74b7b31a9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.114540:0:25028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098f7b5d4/0x50f0cc74b7b31a9d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.114549:0:25028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098f7b5d4/0x50f0cc74b7b31a9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.114565:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.114574:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.114578:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581648.114752:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.114841:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788581648.114918:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581648.114924:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b31aa4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.114934:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=634s v=(0 0) 00010000:00010000:1.0:1788581648.114937:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581648.114943:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b31aa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.114953:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b31aa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.114963:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b31aa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.114970:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b31aa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.115024:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788581648.115517:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788581648.115525:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31aab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.115533:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=634s v=(0 0) 00010000:00010000:1.0:1788581648.115536:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581648.115541:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31aab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.115560:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31aab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.115569:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31aab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.115576:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31aab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.115779:0:25028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581648.115787:0:25028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b31aa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.115795:0:25028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42cca200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.115800:0:25028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b31aa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.115808:0:25028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b31aa4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.115822:0:25028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b31aa4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.115830:0:25028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9769e/0x50f0cc74b7b31aa4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.115849:0:25028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581648.115853:0:25028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31aab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.115872:0:25028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccb200 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581648.115876:0:25028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31aab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.115884:0:25028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31aab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.115896:0:25028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31aab lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581648.115905:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.115907:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581648.115909:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581648.115949:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788581648.115954:0:24133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a592bbf1/0x50f0cc74b7b31aab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788581648.116012:0:24133:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:1.0:1788581648.116096:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22653:x1875463184308864:12345-0@lo:5:osp-pre-1-0.0 Request processed in 105113us (105381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581648.116106:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788581648.116183:0:22653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22653:1875463184308864:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788581648.116199:0:22653:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1788581648.116240:0:22653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432cbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22653:1875463184310016:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788581648.116305:0:22653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581648.116328:0:22653:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e43215600 going to sleep for 11 seconds 00000100:00100000:1.0:1788581648.116345:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184310016 00000100:00100000:1.0:1788581648.116350:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184310016 00000100:00100000:1.0:1788581648.116510:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788581648.116520:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22653:x1875463184310016:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788581648.116551:0:24134:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:0.0:1788581648.117225:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581648.119912:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22653:x1875463184310016:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3389us (3601us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788581648.119923:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788581648.120002:0:22653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432cbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22653:1875463184310016:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788581648.120017:0:22653:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000001:00080000:3.0:1788581648.124819:0:24128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1788581648.124870:0:24128:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788581648.126683:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22651:x1875463184309888:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12383us (13301us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788581648.126695:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788581648.126835:0:22651:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788581648.126845:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22651:1875463184309888:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788581648.126866:0:22651:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000040:00080000:2.0:1788581648.193971:0:23380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788581648.449487:0:22624:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788581648.449495:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e6be35800 from 14 10000000:01000000:1.0:1788581648.449500:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788581648.449925:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31ab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.449939:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31ab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.449951:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31ab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581648.449976:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184310144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788581648.450035:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581648.450076:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a7ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581648.450423:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184310144 00000100:00100000:2.0:1788581648.450431:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184310144 00000100:00100000:2.0:1788581648.450487:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788581648.450498:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:22624:x1875463184310144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581648.450760:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581648.450782:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0ea00/0x50f0cc74b7b31ab9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b31ab2 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.450805:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0ea00/0x50f0cc74b7b31ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b31ab2 expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.450815:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0ea00/0x50f0cc74b7b31ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31ab2 expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.450824:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0ea00, rc 0) 00000100:00100000:2.0:1788581648.450880:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:22624:x1875463184310144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 384us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581648.450887:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788581648.451102:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184310144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581648.451117:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31ab2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31ab9 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.451125:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31ab2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31ab9 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581648.451184:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184310272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788581648.451219:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581648.451246:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e47a7ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581648.451332:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184310272 00000100:00100000:3.0:1788581648.451337:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184310272 00000100:00100000:3.0:1788581648.451373:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788581648.451392:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:22624:x1875463184310272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788581648.451407:0:22620:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788581648.451423:0:22620:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788581648.451426:0:22620:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1788581648.451492:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:22624:x1875463184310272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581648.451500:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788581648.452431:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184310272:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788581648.452497:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788581648.452505:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31ab2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31ab9 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.452525:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42ccbe00/0x50f0cc74b7b31ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31ab9 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581648.452535:0:22624:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788581648.452537:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff995e7f798800 from 14 10000000:01000000:1.0:1788581648.452540:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788581648.452562:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42ccba00/0x50f0cc74b7b31ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.452569:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42ccba00/0x50f0cc74b7b31ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.452577:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42ccba00/0x50f0cc74b7b31ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581648.452598:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184310400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788581648.452634:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581648.452661:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a617c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581648.454793:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184310400 00000100:00100000:2.0:1788581648.454806:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184310400 00000100:00100000:2.0:1788581648.454864:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788581648.454873:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:22624:x1875463184310400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581648.454888:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581648.454905:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0ee00/0x50f0cc74b7b31ac7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b31ac0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.454929:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0ee00/0x50f0cc74b7b31ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b31ac0 expref: 24 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.454939:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0ee00/0x50f0cc74b7b31ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31ac0 expref: 24 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581648.454948:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0ee00, rc 0) 00000100:00100000:2.0:1788581648.455009:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:22624:x1875463184310400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (2375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581648.455025:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788581648.455551:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184310400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581648.455575:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42ccba00/0x50f0cc74b7b31ac0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31ac7 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.455602:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42ccba00/0x50f0cc74b7b31ac0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31ac7 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581648.455665:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184310528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788581648.455711:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581648.455750:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a617c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581648.456156:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184310528 00000100:00100000:3.0:1788581648.456163:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184310528 00000100:00100000:3.0:1788581648.456220:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788581648.456228:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4580b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:22624:x1875463184310528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788581648.456286:0:22621:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788581648.456313:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788581648.456316:0:22621:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1788581648.456444:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4580b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:22624:x1875463184310528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 215us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581648.456451:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788581648.456882:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184310528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788581648.456941:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788581648.456951:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42ccba00/0x50f0cc74b7b31ac0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31ac7 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581648.456959:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42ccba00/0x50f0cc74b7b31ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31ac7 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581648.641411:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581649.670728:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581650.693376:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581651.714536:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581651.780408:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184310656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788581651.780482:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581651.780546:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184310656 00000100:00100000:0.0:1788581651.780555:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184310656 00000100:00100000:0.0:1788581651.780628:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581651.780638:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184310656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788581651.780667:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1788581651.780701:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581651.780717:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184310656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581651.780739:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581651.780793:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184310656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581652.289883:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b64c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184310784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581652.289958:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581652.290024:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184310784 00000100:00100000:2.0:1788581652.290031:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184310784 00000100:00100000:2.0:1788581652.290075:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788581652.290084:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184310784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788581652.290119:0:23367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788581652.290173:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184310784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581652.290180:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788581652.290237:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b64c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184310784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788581652.290728:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581652.290739:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184310912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581652.290818:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581652.291513:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184310912 00000100:00100000:1.0:1788581652.291519:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184310912 00000100:00100000:1.0:1788581652.291622:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788581652.291632:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184310912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788581652.291661:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788581652.291713:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184310912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581652.291720:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788581652.291973:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184310912:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788581652.738857:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788581652.760922:0:25306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788581653.314107:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581653.314150:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b64c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184311040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581653.314247:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581653.314334:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184311040 00000100:00100000:2.0:1788581653.314344:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184311040 00000100:00100000:2.0:1788581653.314715:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788581653.314728:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184311040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581653.314769:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788581653.314828:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184311040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581653.314836:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788581653.314863:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581653.314933:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b64c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184311040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581653.315135:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581653.315165:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184311168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581653.315202:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581653.315285:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184311168 00000100:00100000:3.0:1788581653.315291:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184311168 00000100:00100000:3.0:1788581653.315325:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581653.315332:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875463184311168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581653.315351:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788581653.315387:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875463184311168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581653.315394:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788581653.315545:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581653.315572:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184311168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581653.316685:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184311296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581653.316752:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581653.317687:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a361c037-f8ee-420d-b76d-dbdb9328e15d:3621:1875463184311424:0@lo:400:kworker.0 00000100:00100000:0.0:1788581653.317741:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581653.317805:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184311424 00000100:00100000:0.0:1788581653.317813:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184311424 00000100:00100000:0.0:1788581653.317861:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788581653.317870:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4580a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:3621:x1875463184311424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581653.317921:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4580a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:3621:x1875463184311424:12345-0@lo:400:kworker.0 Request processed in 51us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581653.317928:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788581653.317976:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a361c037-f8ee-420d-b76d-dbdb9328e15d:3621:1875463184311424:0@lo:400:kworker.0 00000100:00100000:2.0:1788581653.320305:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184311296 00000100:00100000:2.0:1788581653.320324:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184311296 00000100:00100000:2.0:1788581653.320417:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788581653.320430:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184311296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788581653.320462:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788581653.320556:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184311296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (3804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581653.320563:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788581653.320757:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581653.320906:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184311296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788581653.321232:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581653.321248:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184311808:0@lo:400:kworker.0 00000100:00100000:2.0:1788581653.321321:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184311680:0@lo:400:kworker.0 00000100:00100000:1.0:1788581653.321333:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581653.321354:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581653.321372:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581653.321377:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184311808 00000100:00100000:2.0:1788581653.321378:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184311552:0@lo:400:kworker.0 00000100:00100000:1.0:1788581653.321383:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184311808 00000100:00100000:2.0:1788581653.321398:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581653.321418:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184311552 00000100:00100000:2.0:1788581653.321428:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788581653.321435:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184311552 00000100:00100000:2.0:1788581653.321447:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184311808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581653.321451:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788581653.321457:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184311552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581653.321494:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184311808:12345-0@lo:400:kworker.0 Request processed in 58us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581653.321500:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184311552:12345-0@lo:400:kworker.0 Request processed in 44us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581653.321502:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788581653.321515:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788581653.321546:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184311808:0@lo:400:kworker.0 00000100:00100000:1.0:1788581653.321588:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184311552:0@lo:400:kworker.0 00000100:00100000:0.0:1788581653.321635:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184311680 00000100:00100000:0.0:1788581653.321640:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184311680 00000100:00100000:0.0:1788581653.321683:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788581653.321690:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184311680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581653.323487:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184311680:12345-0@lo:400:kworker.0 Request processed in 1785us (2119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581653.323503:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788581653.324696:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432cb800 x1875463184311680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581653.324717:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184311680:0@lo:400:kworker.0 00000100:00100000:2.0:1788581653.324776:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581653.324777:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581653.324789:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184311936:0@lo:400:kworker.0 00000100:00100000:1.0:1788581653.324790:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184312064:0@lo:400:kworker.0 00000100:00100000:2.0:1788581653.324946:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581653.325180:0:25026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184311936 00000100:00100000:3.0:1788581653.325189:0:25026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184311936 00000100:00080000:0.0:1788581653.325357:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581653.325411:0:25026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788581653.325423:0:25026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184311936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581653.325729:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581653.325808:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581653.325819:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184312320:0@lo:400:kworker.0 00000100:00100000:1.0:1788581653.325848:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581653.325874:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184312064 00000100:00100000:1.0:1788581653.325879:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184312064 00000100:00100000:1.0:1788581653.325918:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184312320 00000100:00100000:1.0:1788581653.325922:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184312320 00000100:00100000:1.0:1788581653.325951:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788581653.325958:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184312064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581653.326194:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184312192:0@lo:400:kworker.0 00000100:00100000:2.0:1788581653.326227:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788581653.326275:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432ca300 x1875463184312064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581653.326355:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875463184312064:0@lo:400:kworker.0 00000100:00100000:3.0:1788581653.326533:0:25026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184311936:12345-0@lo:400:kworker.0 Request processed in 1112us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581653.326542:0:25026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581653.326616:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184311936:0@lo:400:kworker.0 00000100:00100000:0.0:1788581653.326684:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184312192 00000100:00100000:0.0:1788581653.326689:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184312192 00000100:00100000:0.0:1788581653.326719:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788581653.326728:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184312320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581653.326798:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875463184312320:12345-0@lo:400:kworker.0 Request processed in 72us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581653.326805:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788581653.326822:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788581653.326828:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184312192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581653.326865:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184312192:12345-0@lo:400:kworker.0 Request processed in 37us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581653.326871:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788581653.326947:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432cb800 x1875463184312192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581653.326959:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184312192:0@lo:400:kworker.0 00010000:00080000:3.0:1788581653.327018:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432c8380 x1875463184312320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581653.327036:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875463184312320:0@lo:400:kworker.0 00000100:00100000:1.0:1788581653.327833:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875463184312064:12345-0@lo:400:kworker.0 Request processed in 62us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581653.327845:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788581653.327883:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581653.327888:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788581653.327982:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581653.329439:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184312576:0@lo:400:kworker.0 00000100:00100000:1.0:1788581653.329564:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581653.331003:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184312576 00000100:00100000:0.0:1788581653.331174:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184312576 00000100:00100000:3.0:1788581653.331201:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875463184312448:0@lo:400:kworker.0 00000100:00100000:3.0:1788581653.331348:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788581653.336251:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788581653.337465:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184312448 00000100:00100000:0.0:1788581653.337482:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184312448 00000100:00100000:0.0:1788581653.337576:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788581653.337590:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184312576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581653.337699:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875463184312576:12345-0@lo:400:kworker.0 Request processed in 113us (8146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581653.337708:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788581653.337728:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788581653.337746:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875463184312448:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788581653.337859:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581653.338711:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875463184312448:12345-0@lo:400:kworker.0 Request processed in 971us (7358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581653.338723:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788581653.339476:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432cb800 x1875463184312576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581653.339498:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875463184312576:0@lo:400:kworker.0 00010000:00080000:3.0:1788581653.339505:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d432c8380 x1875463184312448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581653.339520:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875463184312448:0@lo:400:kworker.0 00010000:00010000:0.0:1788581653.768197:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788581653.777653:0:25358:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788581653.777903:0:25358:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:3.0:1788581653.853936:0:24948:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000020:00000004:3.0:1788581654.655507:0:25408:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788581654.658159:0:25408:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788581654.786674:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581654.902503:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581654.902605:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170574592 00000100:00100000:1.0:1788581654.902616:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170574592 00000100:00100000:1.0:1788581654.902669:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00100000:1.0:1788581654.902677:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2392:x1875463170574592:12345-192.168.203.3@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788581654.902703:0:22620:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 40679648-646c-420e-a9fb-5d43fe1ee374@192.168.203.3@tcp t0 exp 0000000000000000 cur 641 last 0 00000020:00000080:1.0:1788581654.902727:0:22620:0:(genops.c:1385:class_connect()) connect: client 40679648-646c-420e-a9fb-5d43fe1ee374, cookie 0x50f0cc74b7b31ace 00000100:00080000:1.0:1788581654.902854:0:22620:0:(import.c:65:import_set_state_nolock()) ffff995d439f8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581654.902922:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+5:2392:x1875463170574592:12345-192.168.203.3@tcp:250:mount.lustre.0 Request processed in 244us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581654.902929:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00100000:3.0:1788581654.914562:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581654.914732:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170574720 00000100:00100000:2.0:1788581654.914743:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170574720 00000100:00100000:2.0:1788581654.914805:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 117 00000100:00100000:2.0:1788581654.914815:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4580a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+5:18081:x1875463170574720:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788581654.914831:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581654.914849:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b31ad5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df22590 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581654.914877:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b31ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22590 expref: 6 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581654.914887:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0e000/0x50f0cc74b7b31ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22590 expref: 6 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581654.914896:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e000, rc 0) 00000100:00100000:2.0:1788581654.914957:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4580a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+6:18081:x1875463170574720:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 144us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581654.914982:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 117 00000100:00100000:3.0:1788581654.923162:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581654.927071:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170574848 00000100:00100000:0.0:1788581654.927098:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170574848 00000100:00100000:0.0:1788581654.927211:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 118 00000100:00100000:0.0:1788581654.927221:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4580ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+6:18081:x1875463170574848:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788581654.927830:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4580ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+6:18081:x1875463170574848:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 609us (4674us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788581654.927841:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 118 00000100:00100000:2.0:1788581654.929467:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581654.929561:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170574976 00000100:00100000:1.0:1788581654.932232:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170574976 00000100:00100000:1.0:1788581654.932509:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:1.0:1788581654.932520:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+6:18081:x1875463170574976:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788581654.932537:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581654.932570:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42ccb200/0x50f0cc74b7b31adc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df22597 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581654.932599:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42ccb200/0x50f0cc74b7b31adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22597 expref: 7 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581654.932610:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42ccb200/0x50f0cc74b7b31adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22597 expref: 7 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581654.932619:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42ccb200, rc 0) 00000100:00100000:1.0:1788581654.932698:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+7:18081:x1875463170574976:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 180us (3237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581654.932705:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:3.0:1788581654.933995:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581654.937459:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170575104 00000100:00100000:2.0:1788581654.937472:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170575104 00000100:00100000:2.0:1788581654.937522:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:2.0:1788581654.937531:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4580b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+7:18081:x1875463170575104:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788581654.937690:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4580b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+8:18081:x1875463170575104:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 159us (3699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581654.937697:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:3.0:1788581654.941983:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581654.942247:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170575232 00000100:00100000:2.0:1788581654.942297:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170575232 00000100:00100000:2.0:1788581654.942362:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:2.0:1788581654.942373:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+8:18081:x1875463170575232:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788581654.942827:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+8:18081:x1875463170575232:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 454us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581654.942836:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:3.0:1788581654.952390:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581654.953319:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170575360 00000100:00100000:0.0:1788581654.953333:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170575360 00000100:00100000:0.0:1788581654.953402:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:0.0:1788581654.953413:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+8:18100:x1875463170575360:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788581654.953581:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+8:18100:x1875463170575360:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 169us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581654.953590:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:0.0:1788581654.993161:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581654.993373:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170575488 00000100:00100000:1.0:1788581654.993387:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170575488 00000100:00100000:1.0:1788581654.993464:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:1.0:1788581654.993476:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4580b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+8:18100:x1875463170575488:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788581654.993707:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4580b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+8:18100:x1875463170575488:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 232us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581654.993716:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:3.0:1788581655.000161:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581655.000319:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170575616 00000100:00100000:2.0:1788581655.000334:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170575616 00000100:00100000:2.0:1788581655.000542:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:2.0:1788581655.000553:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+8:18100:x1875463170575616:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788581655.000728:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+8:18100:x1875463170575616:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 177us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581655.000737:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:3.0:1788581655.004400:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581655.004691:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170575744 00000100:00100000:0.0:1788581655.004706:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170575744 00000100:00100000:0.0:1788581655.004780:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00100000:0.0:1788581655.004791:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4580a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+8:18081:x1875463170575744:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788581655.004807:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581655.004824:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fa71800/0x50f0cc74b7b31ae3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df225c8 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581655.004854:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fa71800/0x50f0cc74b7b31ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df225c8 expref: 9 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581655.004866:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fa71800/0x50f0cc74b7b31ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df225c8 expref: 9 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581655.004893:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71800, rc 0) 00000100:00100000:0.0:1788581655.004957:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4580a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+9:18081:x1875463170575744:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 168us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581655.004964:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00100000:0.0:1788581655.010154:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581655.010492:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170575872 00000100:00100000:1.0:1788581655.010506:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170575872 00000100:00100000:0.0:1788581655.010645:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:0.0:1788581655.010660:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+9:18081:x1875463170575872:12345-192.168.203.3@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788581655.010696:0:22621:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788581655.010728:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788581655.010732:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788581655.010736:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788581655.010739:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788581655.010742:0:22621:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788581655.025597:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+9:18081:x1875463170575872:12345-192.168.203.3@tcp:256:mount.lustre.0 Request processed in 14923us (15449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581655.025618:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:3.0:1788581655.032146:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581655.032874:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170576000 00000100:00100000:2.0:1788581655.032898:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170576000 00000100:00100000:1.0:1788581655.033039:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:1.0:1788581655.033079:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4580bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+9:18081:x1875463170576000:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788581655.033104:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581655.033140:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b31aea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df225cf expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581655.033180:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b31aea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df225cf expref: 10 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581655.033192:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b31aea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df225cf expref: 10 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581655.033202:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42cca200, rc 0) 00000100:00100000:1.0:1788581655.033337:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4580bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+10:18081:x1875463170576000:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 269us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581655.033346:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:3.0:1788581655.037120:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581655.037475:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170576128 00000100:00100000:0.0:1788581655.037488:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170576128 00000100:00100000:0.0:1788581655.037570:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:0.0:1788581655.037583:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+10:18081:x1875463170576128:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788581655.037769:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+10:18081:x1875463170576128:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 188us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581655.037778:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:3.0:1788581655.050657:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581655.050927:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170576256 00000100:00100000:1.0:1788581655.050942:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170576256 00000100:00100000:1.0:1788581655.051019:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:1.0:1788581655.051032:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e523c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+10:18081:x1875463170576256:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788581655.051515:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e523c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+10:18081:x1875463170576256:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 482us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581655.051526:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:3.0:1788581655.056861:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581655.057041:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170576384 00000100:00100000:2.0:1788581655.057055:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170576384 00000100:00100000:2.0:1788581655.057141:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 130 00000100:00100000:2.0:1788581655.057153:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+10:18106:x1875463170576384:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788581655.057411:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+10:18106:x1875463170576384:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 259us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581655.057421:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 130 00000100:00100000:3.0:1788581655.065574:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581655.068671:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170576512 00000100:00100000:0.0:1788581655.068694:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170576512 00000100:00100000:0.0:1788581655.068811:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:0.0:1788581655.068822:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+10:18106:x1875463170576512:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788581655.069036:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+10:18106:x1875463170576512:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 214us (3478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581655.069046:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:2.0:1788581655.093896:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581655.094006:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581655.094110:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170576640 00000100:00100000:1.0:1788581655.094124:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170576640 00000100:00100000:1.0:1788581655.094197:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170576896 00000100:00100000:1.0:1788581655.094200:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170576896 00000100:00100000:1.0:1788581655.094239:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:1.0:1788581655.094250:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1875463170576640:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788581655.094348:0:22627:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 267202bf-c8d5-4953-b113-02f06afe1645@192.168.203.3@tcp t0 exp 0000000000000000 cur 641 last 0 00000020:00000080:1.0:1788581655.094421:0:22627:0:(genops.c:1385:class_connect()) connect: client 267202bf-c8d5-4953-b113-02f06afe1645, cookie 0x50f0cc74b7b31af1 00000004:00100000:1.0:1788581655.094456:0:22627:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788581655.094748:0:22627:0:(import.c:65:import_set_state_nolock()) ffff995d439f8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581655.094839:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267202bf-c8d5-4953-b113-02f06afe1645+6:2392:x1875463170576640:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 588us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581655.094849:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:1.0:1788581655.094873:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:1.0:1788581655.094879:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1875463170576896:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788581655.094897:0:22627:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 267202bf-c8d5-4953-b113-02f06afe1645@192.168.203.3@tcp t0 exp 0000000000000000 cur 641 last 0 00000020:00000080:1.0:1788581655.094936:0:22627:0:(genops.c:1385:class_connect()) connect: client 267202bf-c8d5-4953-b113-02f06afe1645, cookie 0x50f0cc74b7b31af8 00000004:00100000:1.0:1788581655.094951:0:22627:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788581655.095094:0:22627:0:(import.c:65:import_set_state_nolock()) ffff995e4f10e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581655.095122:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267202bf-c8d5-4953-b113-02f06afe1645+6:2392:x1875463170576896:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 241us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581655.095140:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:3.0:1788581655.103643:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581655.105645:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170577152 00000100:00100000:1.0:1788581655.105666:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170577152 00000100:00100000:1.0:1788581655.105782:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:1.0:1788581655.105794:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267202bf-c8d5-4953-b113-02f06afe1645+6:18081:x1875463170577152:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788581655.105845:0:22627:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788581655.105973:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267202bf-c8d5-4953-b113-02f06afe1645+6:18081:x1875463170577152:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 180us (2342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581655.105981:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00080000:3.0:1788581655.106176:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581655.109880:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581655.109936:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581655.110059:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170576768 00000100:00100000:0.0:1788581655.110068:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170577024 00000100:00100000:2.0:1788581655.110073:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170576768 00000100:00100000:0.0:1788581655.110073:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170577024 00000100:00080000:3.0:1788581655.110158:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788581655.110307:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:0.0:1788581655.110321:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+6:0:x1875463170577024:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788581655.110374:0:22626:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788581655.110475:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+6:0:x1875463170577024:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 157us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581655.110482:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:0.0:1788581655.110502:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:0.0:1788581655.110509:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+6:0:x1875463170576768:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788581655.110523:0:22626:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788581655.110570:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+6:0:x1875463170576768:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 61us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581655.110576:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:2.0:1788581655.126544:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581655.126675:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170577280 00000100:00100000:3.0:1788581655.126688:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170577280 00000100:00100000:3.0:1788581655.126766:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:3.0:1788581655.126778:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+6:18081:x1875463170577280:12345-192.168.203.3@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788581655.126884:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+6:18081:x1875463170577280:12345-192.168.203.3@tcp:40:mount.lustre.0 Request processed in 109us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581655.126892:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:3.0:1788581655.130385:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581655.130421:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581655.130457:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581655.130650:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170577408 00000100:00100000:2.0:1788581655.130664:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170577408 00000100:00100000:0.0:1788581655.130671:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170577664 00000100:00100000:0.0:1788581655.130676:0:22637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170577664 00000100:00100000:2.0:1788581655.130714:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170577536 00000100:00100000:2.0:1788581655.130717:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170577536 00000100:00100000:0.0:1788581655.130723:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:0.0:1788581655.130735:0:22637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:267202bf-c8d5-4953-b113-02f06afe1645+6:18081:x1875463170577664:12345-192.168.203.3@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788581655.130736:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:2.0:1788581655.130742:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875463170577408:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788581655.130776:0:24131:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 267202bf-c8d5-4953-b113-02f06afe1645@192.168.203.3@tcp t0 exp 0000000000000000 cur 641 last 0 00000020:00000080:2.0:1788581655.130811:0:24131:0:(genops.c:1385:class_connect()) connect: client 267202bf-c8d5-4953-b113-02f06afe1645, cookie 0x50f0cc74b7b31aff 00002000:00100000:2.0:1788581655.130828:0:24131:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 267202bf-c8d5-4953-b113-02f06afe1645/ffff995d42150000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788581655.130852:0:24131:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788581655.130862:0:22637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:267202bf-c8d5-4953-b113-02f06afe1645+6:18081:x1875463170577664:12345-192.168.203.3@tcp:900:mount.lustre.0 Request processed in 130us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581655.130879:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00002000:00080000:2.0:1788581655.131077:0:24131:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788581655.131115:0:24131:0:(import.c:65:import_set_state_nolock()) ffff995d42151000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581655.131178:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:267202bf-c8d5-4953-b113-02f06afe1645+6:2392:x1875463170577408:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 434us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581655.131198:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:3.0:1788581655.131318:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:3.0:1788581655.131326:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875463170577536:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788581655.131347:0:24665:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 267202bf-c8d5-4953-b113-02f06afe1645@192.168.203.3@tcp t0 exp 0000000000000000 cur 641 last 0 00000020:00000080:3.0:1788581655.131368:0:24665:0:(genops.c:1385:class_connect()) connect: client 267202bf-c8d5-4953-b113-02f06afe1645, cookie 0x50f0cc74b7b31b06 00002000:00100000:3.0:1788581655.131374:0:24665:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 267202bf-c8d5-4953-b113-02f06afe1645/ffff995d42174800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788581655.131388:0:24665:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788581655.131550:0:24665:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788581655.132514:0:24665:0:(import.c:65:import_set_state_nolock()) ffff995d42171800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581655.133188:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:267202bf-c8d5-4953-b113-02f06afe1645+6:2392:x1875463170577536:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 1853us (2721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581655.133200:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:0.0:1788581655.135761:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581655.136740:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170577792 00000100:00100000:1.0:1788581655.136757:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170577792 00000100:00100000:1.0:1788581655.136838:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:1.0:1788581655.136852:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:267202bf-c8d5-4953-b113-02f06afe1645+6:18081:x1875463170577792:12345-192.168.203.3@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788581655.140337:0:22629:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3365us 00000004:00200000:1.0:1788581655.186966:0:22629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788581655.187165:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:267202bf-c8d5-4953-b113-02f06afe1645+6:18081:x1875463170577792:12345-192.168.203.3@tcp:33:mount.lustre.0 Request processed in 50306us (51408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581655.187178:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:2.0:1788581655.443428:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581655.443770:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170577920 00000100:00100000:1.0:1788581655.443787:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170577920 00000100:00100000:1.0:1788581655.443866:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:1.0:1788581655.443878:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+6:18129:x1875463170577920:12345-192.168.203.3@tcp:101:mkdir.0 00010000:00010000:1.0:1788581655.443904:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581655.443938:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb800/0x50f0cc74b7b31b0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22600 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581655.444038:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b31b14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581655.444054:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b31b14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581655.444071:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b31b14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581655.444146:0:22626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788581655.444150:0:22626:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581655.444461:0:22626:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b31b14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581655.444709:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42ccb800/0x50f0cc74b7b31b0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22600 expref: 8 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581655.444797:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b31b14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22600 expref: 7 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581655.444807:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47aa6f00) 00010000:00010000:1.0:1788581655.444810:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581655.444814:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b400, rc 0) 00000100:00100000:1.0:1788581655.444894:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+7:18129:x1875463170577920:12345-192.168.203.3@tcp:101:mkdir.0 Request processed in 1017us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581655.445025:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00010000:00010000:1.0:1788581655.810060:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788581656.260176:0:22661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788581656.833536:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581656.897714:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581656.897738:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184312704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788581656.897810:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581656.897974:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184312704 00000100:00100000:0.0:1788581656.897983:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184312704 00000100:00100000:0.0:1788581656.898039:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788581656.898050:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184312704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788581656.898078:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788581656.898134:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184312704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581656.898141:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788581656.898981:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581656.899027:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184312704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788581657.409678:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7b64ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184312832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788581657.409749:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581657.410637:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184312960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788581657.410676:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581657.410960:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184312832 00000100:00100000:2.0:1788581657.410969:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184312832 00000100:00100000:2.0:1788581657.411019:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184312960 00000100:00100000:2.0:1788581657.411023:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184312960 00000100:00100000:2.0:1788581657.411039:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788581657.411046:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184312832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788581657.411079:0:23367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788581657.411143:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184312832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581657.411150:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788581657.411166:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788581657.411184:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184312960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788581657.411200:0:23367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788581657.411239:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184312960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581657.411245:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788581657.411305:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184312960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581657.411732:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7b64ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184312832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581657.438325:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581657.438605:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170578048 00000100:00100000:0.0:1788581657.438616:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170578048 00000100:00100000:0.0:1788581657.438692:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:0.0:1788581657.438704:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+7:18182:x1875463170578048:12345-192.168.203.3@tcp:41:lfs.0 00000004:00000024:0.0:1788581657.438735:0:23963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00080000:3.0:1788581657.438793:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581657.438826:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+7:18182:x1875463170578048:12345-192.168.203.3@tcp:41:lfs.0 Request processed in 124us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581657.438833:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:2.0:1788581657.445002:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581657.445176:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170578176 00000100:00100000:3.0:1788581657.445185:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170578176 00000100:00100000:3.0:1788581657.445349:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:3.0:1788581657.445360:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+6:18182:x1875463170578176:12345-192.168.203.3@tcp:41:lfs.0 00000004:00000024:3.0:1788581657.445402:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788581657.445503:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+6:18182:x1875463170578176:12345-192.168.203.3@tcp:41:lfs.0 Request processed in 145us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581657.445510:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00080000:1.0:1788581657.449718:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581657.452766:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581657.452971:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170578304 00000100:00100000:0.0:1788581657.452981:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170578304 00000100:00100000:0.0:1788581657.453078:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:0.0:1788581657.453090:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:267202bf-c8d5-4953-b113-02f06afe1645+6:18182:x1875463170578304:12345-192.168.203.3@tcp:13:lfs.0 00002000:00000024:0.0:1788581657.453141:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788581657.453235:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:267202bf-c8d5-4953-b113-02f06afe1645+6:18182:x1875463170578304:12345-192.168.203.3@tcp:13:lfs.0 Request processed in 147us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581657.453243:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00080000:1.0:1788581657.455014:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581657.458804:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581657.459994:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170578432 00000100:00100000:0.0:1788581657.460007:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170578432 00000100:00100000:0.0:1788581657.460100:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:0.0:1788581657.460121:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b64ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:267202bf-c8d5-4953-b113-02f06afe1645+6:18182:x1875463170578432:12345-192.168.203.3@tcp:13:lfs.0 00002000:00000024:0.0:1788581657.460153:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788581657.461008:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b64ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:267202bf-c8d5-4953-b113-02f06afe1645+6:18182:x1875463170578432:12345-192.168.203.3@tcp:13:lfs.0 Request processed in 895us (2215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581657.461018:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00080000:1.0:1788581657.461096:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581657.607034:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581657.607170:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170578560 00000100:00100000:1.0:1788581657.607184:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170578560 00000100:00100000:1.0:1788581657.607311:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:1.0:1788581657.607325:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+10:18213:x1875463170578560:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788581657.607349:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581657.607374:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b31b1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df22607 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581657.607442:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b31b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22607 expref: 11 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581657.607456:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e49e6ae00/0x50f0cc74b7b31b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22607 expref: 11 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581657.607468:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6ae00, rc 0) 00000100:00100000:1.0:1788581657.607745:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+11:18213:x1875463170578560:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 421us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581657.607753:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:2.0:1788581657.622210:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581657.622414:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170578688 00000100:00100000:0.0:1788581657.622428:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170578688 00000100:00100000:0.0:1788581657.622508:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:0.0:1788581657.622521:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+11:18213:x1875463170578688:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788581657.622750:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+11:18213:x1875463170578688:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 232us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581657.622760:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:2.0:1788581657.638206:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581657.638373:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170578816 00000100:00100000:0.0:1788581657.638386:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170578816 00000100:00100000:0.0:1788581657.638460:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:0.0:1788581657.638473:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+11:18213:x1875463170578816:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788581657.638686:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+11:18213:x1875463170578816:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 214us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581657.638702:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:2.0:1788581657.665895:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581657.666119:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170578944 00000100:00100000:1.0:1788581657.666133:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170578944 00000100:00100000:1.0:1788581657.666216:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:1.0:1788581657.666229:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+11:18221:x1875463170578944:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788581657.666776:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+11:18221:x1875463170578944:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 546us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581657.666787:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:2.0:1788581657.688588:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581657.688937:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170579072 00000100:00100000:0.0:1788581657.688950:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170579072 00000100:00100000:0.0:1788581657.689028:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:0.0:1788581657.689041:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+11:18221:x1875463170579072:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788581657.689902:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+11:18221:x1875463170579072:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 854us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581657.689916:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:3.0:1788581657.692766:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581657.695556:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170579200 00000100:00100000:1.0:1788581657.695578:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170579200 00000100:00100000:1.0:1788581657.695662:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 137 00000100:00100000:1.0:1788581657.695686:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+11:18221:x1875463170579200:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788581657.696858:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+11:18221:x1875463170579200:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 1172us (4095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581657.696873:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 137 00000100:00100000:3.0:1788581657.707867:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581657.708132:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170579328 00000100:00100000:0.0:1788581657.708145:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170579328 00000100:00100000:0.0:1788581657.708222:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 138 00000100:00100000:0.0:1788581657.708234:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+11:18213:x1875463170579328:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788581657.708305:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581657.708329:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fa70600/0x50f0cc74b7b31b22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df22638 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581657.708368:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fa70600/0x50f0cc74b7b31b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22638 expref: 12 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581657.708382:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fa70600/0x50f0cc74b7b31b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22638 expref: 12 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581657.708393:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70600, rc 0) 00000100:00100000:0.0:1788581657.708460:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+12:18213:x1875463170579328:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 228us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581657.708469:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 138 00000100:00100000:2.0:1788581657.711392:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581657.711519:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170579456 00000100:00100000:3.0:1788581657.711537:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170579456 00000100:00100000:3.0:1788581657.711611:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 139 00000100:00100000:3.0:1788581657.711623:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+12:18213:x1875463170579456:12345-192.168.203.3@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788581657.711658:0:22621:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788581657.711678:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788581657.711682:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788581657.711686:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788581657.711689:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788581657.711697:0:22621:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1788581657.718800:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+12:18213:x1875463170579456:12345-192.168.203.3@tcp:256:mount.lustre.0 Request processed in 7162us (7405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581657.718831:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 139 00000100:00100000:1.0:1788581657.721612:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581657.721746:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170579584 00000100:00100000:2.0:1788581657.721759:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170579584 00000100:00100000:2.0:1788581657.721878:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:2.0:1788581657.721891:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+12:18213:x1875463170579584:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788581657.721915:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581657.721940:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b31b29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df2263f expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581657.721979:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b31b29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2263f expref: 13 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581657.721991:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b31b29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2263f expref: 13 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581657.722002:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0ec00, rc 0) 00000100:00100000:2.0:1788581657.722080:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+13:18213:x1875463170579584:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 192us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581657.722087:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:2.0:1788581657.724429:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581657.724810:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170579712 00000100:00100000:3.0:1788581657.724823:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170579712 00000100:00100000:3.0:1788581657.724924:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:3.0:1788581657.724937:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+13:18213:x1875463170579712:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788581657.725150:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+13:18213:x1875463170579712:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 215us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581657.725158:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:2.0:1788581657.728179:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581657.728651:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170579840 00000100:00100000:1.0:1788581657.728665:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170579840 00000100:00100000:1.0:1788581657.728779:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:1.0:1788581657.728792:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+13:18213:x1875463170579840:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788581657.728995:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+13:18213:x1875463170579840:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 205us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581657.729004:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:1.0:1788581657.731569:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581657.731905:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170579968 00000100:00100000:3.0:1788581657.731918:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170579968 00000100:00100000:3.0:1788581657.732042:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:3.0:1788581657.732055:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d438a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+13:18225:x1875463170579968:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788581657.732317:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d438a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+13:18225:x1875463170579968:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 263us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581657.732327:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:2.0:1788581657.734795:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581657.737442:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170580096 00000100:00100000:1.0:1788581657.737464:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170580096 00000100:00100000:1.0:1788581657.737557:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 144 00000100:00100000:1.0:1788581657.737571:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+13:18225:x1875463170580096:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788581657.737804:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+13:18225:x1875463170580096:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 234us (3023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581657.737813:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 144 00000100:00100000:2.0:1788581657.752779:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581657.754710:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581657.755816:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170580224 00000100:00100000:0.0:1788581657.755816:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170580480 00000100:00100000:1.0:1788581657.755831:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170580224 00000100:00100000:0.0:1788581657.755831:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170580480 00000100:00100000:1.0:1788581657.755928:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:0.0:1788581657.755934:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:1.0:1788581657.755937:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1875463170580224:12345-192.168.203.3@tcp:38:mount.lustre.0 00000100:00100000:0.0:1788581657.755939:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875463170580480:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788581657.756036:0:22627:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f130e6e6-d193-4588-a48c-a08395bb01b0@192.168.203.3@tcp t0 exp 0000000000000000 cur 643 last 0 00010000:00080000:0.0:1788581657.756036:0:23963:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f130e6e6-d193-4588-a48c-a08395bb01b0@192.168.203.3@tcp t0 exp 0000000000000000 cur 643 last 0 00000020:00000080:1.0:1788581657.756080:0:22627:0:(genops.c:1385:class_connect()) connect: client f130e6e6-d193-4588-a48c-a08395bb01b0, cookie 0x50f0cc74b7b31b30 00000020:00000080:0.0:1788581657.756080:0:23963:0:(genops.c:1385:class_connect()) connect: client f130e6e6-d193-4588-a48c-a08395bb01b0, cookie 0x50f0cc74b7b31b37 00000004:00100000:1.0:1788581657.756125:0:22627:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:0.0:1788581657.756125:0:23963:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788581657.756244:0:22627:0:(import.c:65:import_set_state_nolock()) ffff995d4315c800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788581657.756245:0:23963:0:(import.c:65:import_set_state_nolock()) ffff995d438f8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581657.756364:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f130e6e6-d193-4588-a48c-a08395bb01b0+6:2392:x1875463170580480:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 422us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581657.756373:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:1.0:1788581657.757051:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f130e6e6-d193-4588-a48c-a08395bb01b0+6:2392:x1875463170580224:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 1111us (4286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581657.757061:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:2.0:1788581657.764215:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581657.764326:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581657.764360:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581657.764492:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170580736 00000100:00100000:1.0:1788581657.764506:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170580736 00000100:00100000:3.0:1788581657.764578:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170580608 00000100:00100000:3.0:1788581657.764583:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170580608 00000100:00100000:1.0:1788581657.764588:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170580352 00000100:00100000:1.0:1788581657.764591:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170580352 00000100:00100000:3.0:1788581657.764613:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:3.0:1788581657.764623:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f130e6e6-d193-4588-a48c-a08395bb01b0+7:18213:x1875463170580736:12345-192.168.203.3@tcp:41:mount.lustre.0 00000100:00080000:2.0:1788581657.764646:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788581657.764650:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1788581657.764667:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788581657.764762:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f130e6e6-d193-4588-a48c-a08395bb01b0+7:18213:x1875463170580736:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 140us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581657.771498:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:1.0:1788581657.771748:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f130e6e6-d193-4588-a48c-a08395bb01b0+6:0:x1875463170580608:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788581657.771799:0:23963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788581657.771894:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581657.771932:0:22627:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788581657.771944:0:22627:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788581657.772092:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f130e6e6-d193-4588-a48c-a08395bb01b0+6:0:x1875463170580608:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 575us (7765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581657.772103:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:1.0:1788581657.772145:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170580864 00000100:00100000:1.0:1788581657.772155:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170580864 00000100:00100000:1.0:1788581657.772192:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:1.0:1788581657.772200:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6faced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f130e6e6-d193-4588-a48c-a08395bb01b0+8:0:x1875463170580352:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788581657.772215:0:23963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788581657.772247:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6faced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f130e6e6-d193-4588-a48c-a08395bb01b0+8:0:x1875463170580352:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 48us (7886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581657.772276:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:1.0:1788581657.772667:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:1.0:1788581657.772678:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f130e6e6-d193-4588-a48c-a08395bb01b0+7:18213:x1875463170580864:12345-192.168.203.3@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788581657.772719:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f130e6e6-d193-4588-a48c-a08395bb01b0+7:18213:x1875463170580864:12345-192.168.203.3@tcp:40:mount.lustre.0 Request processed in 45us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581657.772727:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:3.0:1788581657.774965:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:2.0:1788581657.777089:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581657.777183:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581657.780077:0:25026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170580992 00000100:00100000:3.0:1788581657.780131:0:25026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170580992 00000100:00100000:3.0:1788581657.780186:0:25026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170581120 00000100:00100000:3.0:1788581657.780189:0:25026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170581120 00000100:00100000:3.0:1788581657.780214:0:25026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:3.0:1788581657.780225:0:25026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2392:x1875463170580992:12345-192.168.203.3@tcp:8:mount.lustre.0 00000100:00100000:1.0:1788581657.780650:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:1.0:1788581657.780657:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875463170581120:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788581657.780698:0:24134:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f130e6e6-d193-4588-a48c-a08395bb01b0@192.168.203.3@tcp t0 exp 0000000000000000 cur 643 last 0 00000020:00000080:1.0:1788581657.780743:0:24134:0:(genops.c:1385:class_connect()) connect: client f130e6e6-d193-4588-a48c-a08395bb01b0, cookie 0x50f0cc74b7b31b3e 00002000:00100000:1.0:1788581657.780757:0:24134:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f130e6e6-d193-4588-a48c-a08395bb01b0/ffff995d4315e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788581657.780772:0:24134:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788581657.780869:0:24134:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788581657.780913:0:24134:0:(import.c:65:import_set_state_nolock()) ffff995d4315d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581657.781010:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f130e6e6-d193-4588-a48c-a08395bb01b0+6:2392:x1875463170581120:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 350us (3825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581657.781018:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:1.0:1788581657.781933:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581657.782011:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170581248 00000100:00100000:0.0:1788581657.782021:0:22637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170581248 00000100:00100000:0.0:1788581657.782076:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:0.0:1788581657.782084:0:22637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f130e6e6-d193-4588-a48c-a08395bb01b0+6:18213:x1875463170581248:12345-192.168.203.3@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788581657.782156:0:22637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f130e6e6-d193-4588-a48c-a08395bb01b0+6:18213:x1875463170581248:12345-192.168.203.3@tcp:900:mount.lustre.0 Request processed in 72us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581657.782163:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00010000:00080000:3.0:1788581657.782443:0:25026:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f130e6e6-d193-4588-a48c-a08395bb01b0@192.168.203.3@tcp t0 exp 0000000000000000 cur 643 last 0 00000020:00000080:3.0:1788581657.782481:0:25026:0:(genops.c:1385:class_connect()) connect: client f130e6e6-d193-4588-a48c-a08395bb01b0, cookie 0x50f0cc74b7b31b45 00002000:00100000:3.0:1788581657.782495:0:25026:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f130e6e6-d193-4588-a48c-a08395bb01b0/ffff995e7fae3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788581657.782507:0:25026:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788581657.782725:0:25026:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788581657.782784:0:25026:0:(import.c:65:import_set_state_nolock()) ffff995e45dbc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581657.782835:0:25026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f130e6e6-d193-4588-a48c-a08395bb01b0+6:2392:x1875463170580992:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 2611us (5759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581657.782844:0:25026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:2.0:1788581657.785709:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581657.785911:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170581376 00000100:00100000:3.0:1788581657.785924:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170581376 00000100:00100000:3.0:1788581657.786030:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:3.0:1788581657.786044:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f130e6e6-d193-4588-a48c-a08395bb01b0+6:18213:x1875463170581376:12345-192.168.203.3@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788581657.786181:0:22630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788581657.786740:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f130e6e6-d193-4588-a48c-a08395bb01b0+6:18213:x1875463170581376:12345-192.168.203.3@tcp:33:mount.lustre.0 Request processed in 695us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581657.786783:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00010000:00010000:1.0:1788581657.858318:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581657.914894:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581657.915036:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170581504 00000100:00100000:1.0:1788581657.915049:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170581504 00000100:00100000:1.0:1788581657.915124:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:1.0:1788581657.915134:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f130e6e6-d193-4588-a48c-a08395bb01b0+6:18248:x1875463170581504:12345-192.168.203.3@tcp:101:mkdir.0 00010000:00010000:1.0:1788581657.915154:0:23963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581657.915194:0:23963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b31b4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22670 expref: -99 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581657.915285:0:23963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31b53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581657.915298:0:23963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31b53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581657.915311:0:23963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31b53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581657.915372:0:23963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788581657.915376:0:23963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581657.915394:0:23963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31b53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581657.915418:0:23963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6a000/0x50f0cc74b7b31b4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22670 expref: 8 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581657.915437:0:23963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31b53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22670 expref: 7 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581657.915459:0:23963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47aa6f00) 00010000:00010000:1.0:1788581657.915463:0:23963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581657.915466:0:23963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b600, rc 0) 00000100:00100000:1.0:1788581657.915740:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f130e6e6-d193-4588-a48c-a08395bb01b0+7:18248:x1875463170581504:12345-192.168.203.3@tcp:101:mkdir.0 Request processed in 606us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581657.915747:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:2.0:1788581658.433452:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581658.433476:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e6facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184313088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581658.433564:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581658.433623:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184313088 00000100:00100000:2.0:1788581658.433630:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184313088 00000100:00100000:2.0:1788581658.433683:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788581658.433692:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6face300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184313088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581658.433714:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788581658.433757:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6face300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184313088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581658.433764:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788581658.433806:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e6facf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184313088:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788581658.433826:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788581658.434042:0:23380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788581658.435147:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d44071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184313216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581658.435211:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581658.435353:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184313216 00000100:00100000:2.0:1788581658.435361:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184313216 00000100:00100000:2.0:1788581658.435400:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788581658.435410:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184313216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581658.435434:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788581658.435537:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a361c037-f8ee-420d-b76d-dbdb9328e15d:3621:1875463184313472:0@lo:400:kworker.0 00000100:00100000:0.0:1788581658.435574:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581658.435602:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581658.435608:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184313344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581658.435658:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581658.435682:0:24136:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788581658.435690:0:24136:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788581658.435785:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184313344 00000100:00100000:0.0:1788581658.435789:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184313344 00000100:00100000:0.0:1788581658.435893:0:25423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788581658.435900:0:25423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184313344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788581658.435913:0:25423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788581658.435944:0:25423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184313344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581658.435950:0:25423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788581658.435988:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184313344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581658.436024:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184313600:0@lo:400:kworker.0 00000100:00100000:0.0:1788581658.436051:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788581658.436086:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581658.436097:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184313600 00000100:00100000:0.0:1788581658.436101:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184313600 00000100:00100000:0.0:1788581658.436139:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788581658.436145:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184313600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581658.436181:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184313600:12345-0@lo:400:kworker.0 Request processed in 36us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581658.436187:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788581658.436216:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184313600:0@lo:400:kworker.0 00000100:00100000:0.0:1788581658.436242:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184313472 00000100:00100000:0.0:1788581658.436245:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184313472 00000100:00100000:0.0:1788581658.436306:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788581658.436312:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:3621:x1875463184313472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581658.436374:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:3621:x1875463184313472:12345-0@lo:400:kworker.0 Request processed in 61us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581658.436381:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788581658.436413:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a361c037-f8ee-420d-b76d-dbdb9328e15d:3621:1875463184313472:0@lo:400:kworker.0 00000100:00100000:2.0:1788581658.437675:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184313216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2261us (2458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581658.437686:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581658.437973:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788581658.437997:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d44071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184313216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581658.441868:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184313728:0@lo:400:kworker.0 00000100:00100000:1.0:1788581658.441932:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581658.442077:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184314112:0@lo:400:kworker.0 00000100:00100000:0.0:1788581658.442117:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581658.442158:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184313728 00000100:00100000:0.0:1788581658.442165:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184313728 00000100:00100000:0.0:1788581658.442206:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184314112 00000100:00100000:0.0:1788581658.442209:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184314112 00000100:00100000:0.0:1788581658.442229:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788581658.442238:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d432cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184313728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581658.442361:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788581658.442371:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184314112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581658.442415:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184314112:12345-0@lo:400:kworker.0 Request processed in 46us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581658.442422:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788581658.442476:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184314112:0@lo:400:kworker.0 00000100:00100000:2.0:1788581658.442595:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184313856:0@lo:400:kworker.0 00000100:00100000:2.0:1788581658.442625:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581658.442648:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581658.442655:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184313984:0@lo:400:kworker.0 00000100:00100000:2.0:1788581658.442678:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581658.442717:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184313984 00000100:00100000:2.0:1788581658.442721:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184313984 00000100:00100000:2.0:1788581658.442758:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581658.442764:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184313984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581658.442800:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184313984:12345-0@lo:400:kworker.0 Request processed in 36us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581658.442805:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581658.442831:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184313984:0@lo:400:kworker.0 00000100:00080000:2.0:1788581658.442847:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581658.442868:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184313856 00000100:00100000:2.0:1788581658.442871:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184313856 00000100:00100000:2.0:1788581658.442897:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788581658.442903:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6facf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184313856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581658.442940:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6facf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184313856:12345-0@lo:400:kworker.0 Request processed in 37us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581658.442962:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788581658.442991:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184313856:0@lo:400:kworker.0 00000100:00100000:3.0:1788581658.444980:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184314368:0@lo:400:kworker.0 00000100:00100000:3.0:1788581658.445040:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581658.445074:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581658.445080:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184314496:0@lo:400:kworker.0 00000100:00100000:3.0:1788581658.445103:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581658.445143:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184314368 00000100:00100000:3.0:1788581658.445163:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184314368 00000100:00100000:3.0:1788581658.445208:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184314496 00000100:00100000:3.0:1788581658.445211:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184314496 00000100:00100000:3.0:1788581658.445234:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788581658.445242:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184314368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581658.445316:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184314368:12345-0@lo:400:kworker.0 Request processed in 75us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581658.445323:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788581658.445339:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788581658.445345:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184314496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581658.445372:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875463184314496:12345-0@lo:400:kworker.0 Request processed in 28us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581658.445378:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788581658.445413:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875463184314496:0@lo:400:kworker.0 00010000:00080000:3.0:1788581658.445425:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43968a80 x1875463184314368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581658.445435:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184314368:0@lo:400:kworker.0 00000100:00100000:2.0:1788581658.445606:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184314624:0@lo:400:kworker.0 00000100:00100000:2.0:1788581658.445643:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581658.445666:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581658.445672:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184314240:0@lo:400:kworker.0 00000100:00100000:2.0:1788581658.445694:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788581658.445731:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581658.445735:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581658.445744:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184314624 00000100:00100000:2.0:1788581658.445748:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184314624 00000100:00100000:2.0:1788581658.445771:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184314240 00000100:00100000:2.0:1788581658.445773:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184314240 00000100:00100000:2.0:1788581658.445789:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788581658.445794:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184314624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581658.445831:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184314624:12345-0@lo:400:kworker.0 Request processed in 36us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581658.445837:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788581658.445849:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788581658.445855:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184314240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581658.445880:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875463184314240:12345-0@lo:400:kworker.0 Request processed in 25us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581658.445886:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788581658.445900:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581658.445903:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788581658.445920:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875463184314240:0@lo:400:kworker.0 00010000:00080000:2.0:1788581658.445942:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d4396ad80 x1875463184314624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581658.445951:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184314624:0@lo:400:kworker.0 00000100:00100000:0.0:1788581658.446618:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d432cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875463184313728:12345-0@lo:400:kworker.0 Request processed in 4377us (4681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581658.446627:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788581658.446707:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875463184313728:0@lo:400:kworker.0 00010000:00010000:1.0:1788581658.887248:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581659.909278:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788581660.466546:0:25508:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788581660.938539:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788581660.996157:0:23359:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f130e6e6-d193-4588-a48c-a08395bb01b0 00000001:00100000:0.0:1788581660.996177:0:23359:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 267202bf-c8d5-4953-b113-02f06afe1645 00000001:00100000:3.0:1788581660.996358:0:24128:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f130e6e6-d193-4588-a48c-a08395bb01b0 00000001:00100000:3.0:1788581660.996368:0:24128:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 267202bf-c8d5-4953-b113-02f06afe1645 00000001:00100000:1.0:1788581660.996424:0:24948:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f130e6e6-d193-4588-a48c-a08395bb01b0 00000001:00100000:1.0:1788581660.996437:0:24948:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 267202bf-c8d5-4953-b113-02f06afe1645 00000001:00100000:2.0:1788581660.997008:0:22607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f130e6e6-d193-4588-a48c-a08395bb01b0 00000001:00100000:2.0:1788581660.997017:0:22607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 267202bf-c8d5-4953-b113-02f06afe1645 00010000:00010000:3.0:1788581661.964273:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581662.019652:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184314752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581662.019773:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581662.019898:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184314752 00000100:00100000:2.0:1788581662.019907:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184314752 00000100:00100000:2.0:1788581662.019985:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788581662.019996:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d44071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184314752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788581662.020027:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1788581662.020113:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581662.020215:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d44071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184314752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 222us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581662.020222:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788581662.020314:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184314752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788581662.530169:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788581662.530202:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184314880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788581662.530335:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581662.530415:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184314880 00000100:00100000:2.0:1788581662.530423:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184314880 00000100:00100000:2.0:1788581662.530480:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788581662.530489:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184314880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788581662.531174:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788581662.532682:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184314880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2187us (2340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581662.532693:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788581662.533437:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184314880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581662.533968:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184315008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581662.534025:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581662.534166:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184315008 00000100:00100000:2.0:1788581662.534180:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184315008 00000100:00100000:2.0:1788581662.534237:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788581662.534246:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184315008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788581662.534311:0:23367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788581662.534373:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184315008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581662.534380:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788581662.535479:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e7f615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184315008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581662.958367:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581662.958515:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581662.958549:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581662.958591:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581662.958627:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581662.958631:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170581888 00000100:00100000:2.0:1788581662.958648:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170581888 00000100:00100000:1.0:1788581662.958658:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581662.958685:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581662.958711:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581662.958782:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170582144 00000100:00100000:3.0:1788581662.958791:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170582144 00000100:00100000:3.0:1788581662.958848:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170582656 00000100:00100000:3.0:1788581662.958851:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170582656 00000100:00100000:3.0:1788581662.958884:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170582016 00000100:00100000:3.0:1788581662.958887:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170582016 00000100:00100000:3.0:1788581662.958937:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:3.0:1788581662.958949:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267202bf-c8d5-4953-b113-02f06afe1645+5:2394:x1875463170582144:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581662.959043:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267202bf-c8d5-4953-b113-02f06afe1645+5:2394:x1875463170582144:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 95us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581662.959051:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:3.0:1788581662.959069:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:3.0:1788581662.959088:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f130e6e6-d193-4588-a48c-a08395bb01b0+5:2394:x1875463170582656:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581662.959114:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f130e6e6-d193-4588-a48c-a08395bb01b0+5:2394:x1875463170582656:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 38us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581662.959120:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:3.0:1788581662.959131:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:3.0:1788581662.959138:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267202bf-c8d5-4953-b113-02f06afe1645+5:2394:x1875463170582016:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581662.959160:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267202bf-c8d5-4953-b113-02f06afe1645+5:2394:x1875463170582016:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581662.959167:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00080000:3.0:1788581662.959186:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581662.959191:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581662.959194:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788581662.964030:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170581632 00000100:00100000:0.0:1788581662.964053:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170581632 00000100:00100000:0.0:1788581662.964144:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 146 00000100:00100000:0.0:1788581662.964156:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+13:2394:x1875463170581632:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1788581662.964291:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+13:2394:x1875463170581632:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 135us (6100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581662.964322:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 146 00000100:00100000:2.0:1788581662.965645:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170582400 00000100:00100000:2.0:1788581662.965661:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170582400 00000100:00100000:1.0:1788581662.970634:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581662.970704:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170581760 00000100:00100000:1.0:1788581662.970717:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170581760 00000100:00100000:1.0:1788581662.970777:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170582272 00000100:00100000:1.0:1788581662.970781:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170582272 00000100:00100000:1.0:1788581662.970802:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:1.0:1788581662.970814:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+5:2394:x1875463170581888:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581662.971006:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+5:2394:x1875463170581888:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 101us (12403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581662.971035:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:1.0:1788581662.971058:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:1.0:1788581662.971141:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f130e6e6-d193-4588-a48c-a08395bb01b0+5:2394:x1875463170582400:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581662.971172:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f130e6e6-d193-4588-a48c-a08395bb01b0+5:2394:x1875463170582400:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 107us (12581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581662.971178:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:1.0:1788581662.971192:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:1.0:1788581662.971198:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+6:2394:x1875463170581760:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581662.971223:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+6:2394:x1875463170581760:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (12567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581662.971230:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:1.0:1788581662.971243:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:1.0:1788581662.971250:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f130e6e6-d193-4588-a48c-a08395bb01b0+6:2394:x1875463170582272:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581662.971304:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f130e6e6-d193-4588-a48c-a08395bb01b0+6:2394:x1875463170582272:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 54us (12593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581662.971310:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:1.0:1788581662.971491:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170582528 00000100:00100000:1.0:1788581662.971497:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170582528 00000100:00100000:1.0:1788581662.971536:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:1.0:1788581662.971544:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f130e6e6-d193-4588-a48c-a08395bb01b0+5:2394:x1875463170582528:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581662.971646:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f130e6e6-d193-4588-a48c-a08395bb01b0+5:2394:x1875463170582528:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 102us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581662.971654:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00080000:1.0:1788581662.971760:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581662.971765:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581662.971768:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788581662.977888:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581663.553537:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184315392:0@lo:400:kworker.0 00000100:00100000:3.0:1788581663.553610:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581663.553659:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184315904:0@lo:400:kworker.0 00000100:00100000:3.0:1788581663.553683:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581663.553944:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184316416:0@lo:400:kworker.0 00000100:00100000:3.0:1788581663.553978:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581663.559720:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184315264:0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.559793:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581663.559836:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184315776:0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.559853:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581663.559864:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184316288:0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.559883:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184315520:0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.559900:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581663.559952:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a361c037-f8ee-420d-b76d-dbdb9328e15d:3618:1875463184315136:0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.560389:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184316032:0@lo:400:kworker.0 00000100:00100000:2.0:1788581663.560399:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581663.560429:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581663.560443:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184315648:0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.560453:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875463184316544:0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.560477:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581663.560517:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184315264 00000100:00100000:1.0:1788581663.560524:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184315264 00000100:00100000:2.0:1788581663.560565:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581663.560599:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184316160:0@lo:400:kworker.0 00000100:00100000:2.0:1788581663.560622:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581663.560753:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184315776 00000100:00100000:1.0:1788581663.560758:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184315776 00000100:00100000:2.0:1788581663.560773:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184316672:0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.560782:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788581663.560794:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184315264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581663.560805:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581663.560850:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184315264:12345-0@lo:400:kworker.0 Request processed in 58us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581663.560857:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788581663.560874:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788581663.560881:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184315776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.560925:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184315776:12345-0@lo:400:kworker.0 Request processed in 45us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581663.560932:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788581663.560957:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184315392 00000100:00100000:1.0:1788581663.560961:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184315392 00000100:00100000:1.0:1788581663.561001:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184315904 00000100:00100000:1.0:1788581663.561004:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184315904 00000100:00100000:1.0:1788581663.561019:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184315520 00000100:00100000:1.0:1788581663.561022:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184315520 00000100:00100000:2.0:1788581663.561045:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184315136 00000100:00100000:2.0:1788581663.561050:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184315136 00000100:00100000:2.0:1788581663.561092:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788581663.561118:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184316032 00000100:00100000:1.0:1788581663.561123:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184316032 00000100:00100000:1.0:1788581663.561140:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581663.561147:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184315392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.561181:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184315392:12345-0@lo:400:kworker.0 Request processed in 34us (7572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581663.561186:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581663.561198:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581663.561205:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184315904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.561234:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184315904:12345-0@lo:400:kworker.0 Request processed in 30us (7550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581663.561239:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581663.561249:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788581663.561275:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184315520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.561370:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184315520:12345-0@lo:400:kworker.0 Request processed in 115us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581663.561376:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788581663.561387:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581663.561400:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184316032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.561458:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184316032:12345-0@lo:400:kworker.0 Request processed in 59us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581663.561464:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581663.561484:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184316416 00000100:00100000:1.0:1788581663.561488:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184316416 00000100:00100000:1.0:1788581663.561505:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184316544 00000100:00100000:1.0:1788581663.561508:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184316544 00000100:00100000:1.0:1788581663.561518:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184315648 00000100:00100000:1.0:1788581663.561520:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184315648 00000100:00100000:1.0:1788581663.561531:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184316160 00000100:00100000:1.0:1788581663.561534:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184316160 00000100:00100000:2.0:1788581663.561548:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:3618:x1875463184315136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.561548:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184316672 00000100:00100000:1.0:1788581663.561552:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184316672 00000100:00100000:2.0:1788581663.561595:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:3618:x1875463184315136:12345-0@lo:400:kworker.0 Request processed in 497us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581663.561602:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788581663.561790:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788581663.561799:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184316416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.561838:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788581663.561846:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184316416:12345-0@lo:400:kworker.0 Request processed in 48us (7867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581663.561849:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875463184316544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581663.561858:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788581663.561879:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788581663.561888:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184315648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.561893:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875463184316544:12345-0@lo:400:kworker.0 Request processed in 46us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581663.561900:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788581663.561915:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788581663.561922:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184316160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581663.561930:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875463184315648:12345-0@lo:400:kworker.0 Request processed in 43us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581663.561938:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788581663.561958:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788581663.561959:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184316160:12345-0@lo:400:kworker.0 Request processed in 37us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581663.561970:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788581663.561971:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184316672:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788581663.561997:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581663.562003:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788581663.562006:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788581663.562010:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581663.562014:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184316672:12345-0@lo:400:kworker.0 Request processed in 47us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581663.562023:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788581663.562061:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a361c037-f8ee-420d-b76d-dbdb9328e15d:3618:1875463184315136:0@lo:400:kworker.0 00000100:00100000:2.0:1788581663.562089:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875463184315648:0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.562116:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184315520:0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.562137:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184316032:0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.562148:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875463184316544:0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.562168:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581663.562177:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184316928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581663.562206:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581663.562238:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184316928 00000100:00100000:1.0:1788581663.562242:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184316928 00000100:00100000:2.0:1788581663.562354:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184316160:0@lo:400:kworker.0 00010000:00080000:2.0:1788581663.562370:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d43969880 x1875463184316672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581663.562379:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184316672:0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.562472:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788581663.562482:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184316928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581663.562495:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788581663.562532:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875463184316928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581663.562538:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788581663.562551:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581663.562579:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184316800:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581663.562605:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581663.562773:0:25423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184316800 00000100:00100000:2.0:1788581663.562778:0:25423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184316800 00000100:00100000:2.0:1788581663.562802:0:25423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788581663.562805:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184315264:0@lo:400:kworker.0 00000100:00100000:2.0:1788581663.562817:0:25423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184316800:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788581663.562836:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184315776:0@lo:400:kworker.0 00002000:00000024:2.0:1788581663.562839:0:25423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788581663.562877:0:25423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184316800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581663.562883:0:25423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788581663.563010:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184316800:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788581663.563035:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d4396ad80 x1875463184316416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581663.563045:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184316416:0@lo:400:kworker.0 00000100:00100000:3.0:1788581663.563063:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184315392:0@lo:400:kworker.0 00000100:00100000:3.0:1788581663.563088:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184315904:0@lo:400:kworker.0 00000100:00100000:3.0:1788581663.563098:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581663.563104:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184317056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581663.563128:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581663.564437:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184317056 00000100:00100000:1.0:1788581663.564449:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184317056 00000100:00100000:1.0:1788581663.564576:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788581663.564586:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184317056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581663.564606:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788581663.564667:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184317056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (1538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581663.564674:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788581663.564720:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875463184316928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581663.564750:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184316288 00000100:00100000:1.0:1788581663.564753:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184316288 00000100:00100000:1.0:1788581663.564787:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788581663.564804:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184316288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.564845:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875463184316288:12345-0@lo:400:kworker.0 Request processed in 44us (2295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581663.564851:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788581663.564871:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581663.564898:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875463184316288:0@lo:400:kworker.0 00000100:00100000:1.0:1788581663.564934:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184317056:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1788581663.665313:0:25657:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4a307de0 20000000:00000080:0.0:1788581663.665329:0:25657:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff995e6f7f2400 uarg=0000000000000000 20000000:01000000:0.0:1788581663.665383:0:25657:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788581663.665390:0:25657:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788581663.665394:0:25657:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788581663.665866:0:25658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788581663.666067:0:25657:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788581663.674740:0:25657:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788581663.674772:0:25657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b5a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.674790:0:25657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b317b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b317b0 expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.674797:0:25657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b317c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b317be expref: 23 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.674803:0:25657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42b0e400/0x50f0cc74b7b31804 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b317fd expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.674810:0:25657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b3189e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31897 expref: 23 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.674819:0:25657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b31aea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df225cf expref: 12 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.674826:0:25657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b31b29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2263f expref: 12 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.674832:0:25657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b5a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.674890:0:25657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b31b29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2263f expref: 12 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.674906:0:25657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b31b29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2263f expref: 12 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581663.674920:0:25657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a95f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25657:1875463184317184:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581663.675110:0:25657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b31aea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df225cf expref: 12 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.675120:0:25657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b31aea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df225cf expref: 12 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581663.675129:0:25657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a96300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25657:1875463184317312:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581663.675314:0:25657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b3189e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b31897 expref: 23 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.675322:0:25657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b3189e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b31897 expref: 23 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581663.675332:0:25657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43a95880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25657:1875463184317440:0@lo:104: 00000100:00100000:0.0:1788581663.675468:0:25657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788581663.675543:0:25657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e42b0e400/0x50f0cc74b7b31804 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b317fd expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.675552:0:25657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e42b0e400/0x50f0cc74b7b31804 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b317fd expref: 23 pid: 22621 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581663.675572:0:25657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25657:1875463184317568:0@lo:104: 00000100:00100000:0.0:1788581663.675599:0:25657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788581663.675622:0:25657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b317c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b317be expref: 23 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.675631:0:25657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b317c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b317be expref: 23 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581663.675639:0:25657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43279500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25657:1875463184317696:0@lo:104: 00000100:00100000:0.0:1788581663.675658:0:25657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788581663.675675:0:25657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b317b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50f0cc74b7b317b0 expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.675683:0:25657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b317b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50f0cc74b7b317b0 expref: 23 pid: 22622 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581663.675690:0:25657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25657:1875463184317824:0@lo:104: 00000100:00100000:0.0:1788581663.675710:0:25657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581663.675715:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184317440 00000100:00100000:0.0:1788581663.675720:0:25657:0:(client.c:2715:ptlrpc_set_wait()) set ffff995d4108a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788581663.675722:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184317440 00000100:00100000:3.0:1788581663.675758:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184317568 00000100:00100000:3.0:1788581663.675761:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184317568 00000100:00100000:3.0:1788581663.675772:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184317696 00000100:00100000:3.0:1788581663.675775:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184317696 00000100:00100000:3.0:1788581663.675782:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184317824 00000100:00100000:3.0:1788581663.675784:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184317824 00000100:00100000:3.0:1788581663.675796:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788581663.675804:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+6:25657:x1875463184317440:12345-0@lo:104: 00010000:00010000:3.0:1788581663.675816:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995d43272400/0x50f0cc74b7b31897 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b3189e expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581663.675886:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788581663.675893:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+6:25657:x1875463184317440:12345-0@lo:104: Request processed in 90us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581663.675900:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788581663.675918:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788581663.675924:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+5:25657:x1875463184317568:12345-0@lo:104: 00010000:00010000:3.0:1788581663.675932:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995e42ccac00/0x50f0cc74b7b317fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b31804 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581663.676050:0:25657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a95880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25657:1875463184317440:0@lo:104: 00000100:00100000:0.0:1788581663.676057:0:25657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43835180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25657:1875463184317568:0@lo:104: 00010000:00010000:3.0:1788581663.676131:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788581663.676137:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+5:25657:x1875463184317568:12345-0@lo:104: Request processed in 214us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581663.676144:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788581663.676169:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788581663.676176:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+4:25657:x1875463184317696:12345-0@lo:104: 00010000:00010000:3.0:1788581663.676183:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995d43272c00/0x50f0cc74b7b317be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b317c5 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581663.679147:0:25657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43279500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25657:1875463184317696:0@lo:104: 00010000:00010000:0.0:1788581663.679372:0:25028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788581663.679381:0:25028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995d43272400/0x50f0cc74b7b31897 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b3189e expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.679391:0:25028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581663.679395:0:25028:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995d43272400/0x50f0cc74b7b31897 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b3189e expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.679423:0:25028:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995d43272400/0x50f0cc74b7b31897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b3189e expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581663.679430:0:25028:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995d43272400/0x50f0cc74b7b31897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b3189e expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581663.679436:0:25028:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788581663.679995:0:25028:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995d43272400/0x50f0cc74b7b31897 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b3189e expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.680004:0:25028:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581663.680044:0:25028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995d43272400/0x50f0cc74b7b31897 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b3189e expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.680051:0:25028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995d43272400/0x50f0cc74b7b31897 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b3189e expref: -99 pid: 24947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.680067:0:25028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581663.680081:0:25028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995e42ccac00/0x50f0cc74b7b317fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b31804 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.680088:0:25028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42ccac00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581663.680091:0:25028:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995e42ccac00/0x50f0cc74b7b317fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b31804 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.680098:0:25028:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995e42ccac00/0x50f0cc74b7b317fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b31804 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581663.680106:0:25028:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995e42ccac00/0x50f0cc74b7b317fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b31804 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581663.680121:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a361c037-f8ee-420d-b76d-dbdb9328e15d:3618:1875463184317952:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1788581663.680122:0:25028:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788581663.680162:0:25028:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995e42ccac00/0x50f0cc74b7b317fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31804 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.680169:0:25028:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581663.680176:0:25028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995e42ccac00/0x50f0cc74b7b317fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31804 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.680182:0:25028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995e42ccac00/0x50f0cc74b7b317fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b31804 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581663.680193:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788581663.680193:0:25028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581663.680198:0:25028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995d43272c00/0x50f0cc74b7b317be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b317c5 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.680206:0:25028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43272c00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788581663.680220:0:25028:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995d43272c00/0x50f0cc74b7b317be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b317c5 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.680227:0:25028:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995d43272c00/0x50f0cc74b7b317be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b317c5 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581663.680234:0:25028:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995d43272c00/0x50f0cc74b7b317be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b317c5 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581663.680239:0:25028:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788581663.680242:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581663.680251:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a361c037-f8ee-420d-b76d-dbdb9328e15d:3618:1875463184318080:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581663.680292:0:25028:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995d43272c00/0x50f0cc74b7b317be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b317c5 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.680299:0:25028:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581663.680321:0:25028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995d43272c00/0x50f0cc74b7b317be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b317c5 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.680326:0:25028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995d43272c00/0x50f0cc74b7b317be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b317c5 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.680334:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581663.680336:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581663.680339:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581663.680357:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184317952 00000100:00100000:0.0:1788581663.680364:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184317952 00010000:00010000:0.0:1788581663.680392:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b3189e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b31897 expref: 24 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581663.680420:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788581663.680430:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:3618:x1875463184317952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581663.680441:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581663.680446:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b3189e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b31897 expref: 24 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.680455:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b3189e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b31897 expref: 24 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.680468:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6b800/0x50f0cc74b7b3189e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b31897 expref: 24 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.680481:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581663.680614:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581663.681025:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:3618:x1875463184317952:12345-0@lo:103:ldlm_bl.0 Request processed in 596us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581663.681033:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788581663.681057:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184318080 00000100:00100000:0.0:1788581663.681061:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184318080 00010000:00010000:0.0:1788581663.681084:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42b0e400/0x50f0cc74b7b31804 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b317fd expref: 23 pid: 22621 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581663.681105:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788581663.681111:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:3618:x1875463184318080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581663.681119:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581663.681123:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42b0e400/0x50f0cc74b7b31804 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b317fd expref: 23 pid: 22621 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.681131:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42b0e400/0x50f0cc74b7b31804 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b317fd expref: 23 pid: 22621 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.681142:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0e400/0x50f0cc74b7b31804 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b317fd expref: 23 pid: 22621 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.681152:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581663.681173:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:3618:x1875463184318080:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581663.681179:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788581663.681198:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184318208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581663.681233:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581663.681284:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184318208 00000100:00100000:0.0:1788581663.681287:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184318208 00010000:00010000:0.0:1788581663.681300:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b317c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b317be expref: 22 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581663.681313:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788581663.681318:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:3620:x1875463184318208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581663.681330:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581663.681334:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b317c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b317be expref: 22 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.681343:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b317c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b317be expref: 22 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.681352:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6b200/0x50f0cc74b7b317c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b317be expref: 22 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.681361:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581663.681384:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:3620:x1875463184318208:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581663.681390:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788581663.681420:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184318208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581663.682747:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a361c037-f8ee-420d-b76d-dbdb9328e15d:3618:1875463184318080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581663.682760:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a361c037-f8ee-420d-b76d-dbdb9328e15d:3618:1875463184317952:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581663.684165:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581663.684196:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581663.687969:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788581663.687988:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+4:25657:x1875463184317696:12345-0@lo:104: Request processed in 11807us (12323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581663.688001:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788581663.688044:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788581663.688059:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+3:25657:x1875463184317824:12345-0@lo:104: 00010000:00010000:3.0:1788581663.688084:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b317b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b317b7 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581663.688216:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788581663.688223:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a361c037-f8ee-420d-b76d-dbdb9328e15d+3:25657:x1875463184317824:12345-0@lo:104: Request processed in 171us (12511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581663.688229:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788581663.688293:0:25028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581663.688301:0:25028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b317b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50f0cc74b7b317b7 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581663.688309:0:25028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995d43273000 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788581663.688313:0:25028:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b317b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50f0cc74b7b317b7 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581663.688322:0:25028:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b317b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50f0cc74b7b317b7 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581663.688330:0:25028:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b317b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50f0cc74b7b317b7 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581663.688337:0:25028:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788581663.688381:0:25028:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b317b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b317b7 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581663.688389:0:25028:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581663.688408:0:25028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b317b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b317b7 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581663.688416:0:25028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff995d43273000/0x50f0cc74b7b317b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50f0cc74b7b317b7 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581663.688441:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581663.688444:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581663.688446:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581663.688521:0:25657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a95f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25657:1875463184317184:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581663.688532:0:25657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43a96300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25657:1875463184317312:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581663.688540:0:25657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25657:1875463184317824:0@lo:104: 00010000:00010000:1.0:1788581663.688591:0:25657:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b5a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581663.688929:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581663.689121:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170582784 00000100:00100000:1.0:1788581663.689128:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170582784 00010000:00010000:1.0:1788581663.689159:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b31b29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2263f expref: 13 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581663.689192:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:1.0:1788581663.689199:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40679648-646c-420e-a9fb-5d43fe1ee374+13:2395:x1875463170582784:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581663.689210:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581663.689235:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b31b29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2263f expref: 13 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581663.689311:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b31b29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2263f expref: 13 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581663.689327:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b31b29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2263f expref: 13 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581663.689340:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581663.689381:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40679648-646c-420e-a9fb-5d43fe1ee374+12:2395:x1875463170582784:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 182us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581663.689387:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:3.0:1788581663.690854:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581663.691804:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170582912 00000100:00100000:3.0:1788581663.691815:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170582912 00010000:00010000:3.0:1788581663.691855:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b31aea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df225cf expref: 12 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581663.691892:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:3.0:1788581663.691902:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b535050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40679648-646c-420e-a9fb-5d43fe1ee374+12:2395:x1875463170582912:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581663.691915:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581663.691920:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b31aea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df225cf expref: 12 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581663.691932:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b31aea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df225cf expref: 12 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581663.691949:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e42cca200/0x50f0cc74b7b31aea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df225cf expref: 12 pid: 22620 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581663.692689:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581663.692783:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b535050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40679648-646c-420e-a9fb-5d43fe1ee374+11:2395:x1875463170582912:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 881us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581663.692791:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:0.0:1788581663.692995:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a361c037-f8ee-420d-b76d-dbdb9328e15d:3621:1875463184318336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581663.693044:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581663.693162:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184318336 00000100:00100000:3.0:1788581663.693169:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184318336 00010000:00010000:3.0:1788581663.693190:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b317b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b317b0 expref: 21 pid: 22622 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581663.693221:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788581663.693228:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:3621:x1875463184318336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581663.693238:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581663.693243:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b317b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50f0cc74b7b317b0 expref: 21 pid: 22622 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581663.693275:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b317b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50f0cc74b7b317b0 expref: 21 pid: 22622 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581663.693289:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e49e6aa00/0x50f0cc74b7b317b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50f0cc74b7b317b0 expref: 21 pid: 22622 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581663.693299:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b5a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581663.693307:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b5a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581663.693322:0:22613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b5a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581663.693328:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b5a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581663.693335:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b5a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581663.693350:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b5a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581663.693356:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70400 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:3.0:1788581663.693359:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b5a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581663.693367:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b5a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581663.693382:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b5a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581663.693392:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581663.693423:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a361c037-f8ee-420d-b76d-dbdb9328e15d+20:3621:x1875463184318336:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581663.693429:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788581663.693458:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a361c037-f8ee-420d-b76d-dbdb9328e15d:3621:1875463184318336:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581663.694392:0:25657:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b5a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.694404:0:25657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b5a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581663.694411:0:25657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b5a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581664.001408:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581664.950225:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581664.950414:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170583040 00000100:00100000:0.0:1788581664.950424:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170583040 00000100:00100000:0.0:1788581664.950491:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 148 00000100:00100000:0.0:1788581664.950517:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+11:18095:x1875463170583040:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581664.950534:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581664.950553:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df22677 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581664.950583:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22677 expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581664.950594:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fa70400/0x50f0cc74b7b31b61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22677 expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581664.950603:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70400, rc 0) 00000100:00100000:0.0:1788581664.950977:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+12:18095:x1875463170583040:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 461us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581664.950985:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 148 00000100:00100000:2.0:1788581664.961709:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581664.962006:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170583168 00000100:00100000:0.0:1788581664.962016:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170583168 00000100:00100000:0.0:1788581664.962087:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 149 00000100:00100000:0.0:1788581664.962097:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e47fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+12:18095:x1875463170583168:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581664.962368:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e47fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+12:18095:x1875463170583168:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 271us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581664.962376:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 149 00000100:00100000:1.0:1788581664.972949:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581664.973129:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170583296 00000100:00100000:2.0:1788581664.973139:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170583296 00000100:00100000:2.0:1788581664.973198:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00100000:2.0:1788581664.973209:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+12:18095:x1875463170583296:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581664.973634:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+12:18095:x1875463170583296:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 425us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581664.973642:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00100000:3.0:1788581664.983717:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581664.985736:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170583424 00000100:00100000:2.0:1788581664.985756:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170583424 00000100:00100000:2.0:1788581664.985853:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:2.0:1788581664.985866:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+12:18095:x1875463170583424:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581664.985888:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581664.985912:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b31b68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3786f996df2267e expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581664.985951:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b31b68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2267e expref: 13 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581664.985964:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0fe00/0x50f0cc74b7b31b68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2267e expref: 13 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581664.985975:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0fe00, rc 0) 00000100:00100000:2.0:1788581664.986244:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+13:18095:x1875463170583424:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 379us (2539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581664.986272:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:1.0:1788581664.994419:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581664.996667:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170583552 00000100:00100000:2.0:1788581664.996688:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170583552 00000100:00100000:2.0:1788581664.996784:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00100000:2.0:1788581664.996797:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+13:18095:x1875463170583552:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581664.997028:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40679648-646c-420e-a9fb-5d43fe1ee374+13:18095:x1875463170583552:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 231us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581664.997037:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00100000:1.0:1788581665.000616:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581665.002857:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170583680 00000100:00100000:2.0:1788581665.002881:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170583680 00000100:00100000:2.0:1788581665.002982:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 153 00000100:00100000:2.0:1788581665.002994:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+13:18095:x1875463170583680:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581665.003216:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40679648-646c-420e-a9fb-5d43fe1ee374+13:18095:x1875463170583680:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 223us (2614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581665.003230:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 153 00010000:00010000:1.0:1788581665.025787:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788581665.157013:0:22624:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788581665.157026:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e7fa4f000 from 13 10000000:01000000:2.0:1788581665.157034:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788581665.157114:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b31b6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.157127:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b31b6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.157141:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b31b6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581665.157198:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e766ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184318464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788581665.157331:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581665.157384:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e512b1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788581665.158815:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184318464 00000100:00100000:0.0:1788581665.158833:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184318464 00000100:00100000:2.0:1788581665.159960:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788581665.159994:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+20:22624:x1875463184318464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581665.160018:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581665.160042:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b31b76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b31b6f expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.160319:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b31b76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b31b6f expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.160336:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0ec00/0x50f0cc74b7b31b76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31b6f expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.160347:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0ec00, rc 0) 00000100:00100000:2.0:1788581665.160472:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:22624:x1875463184318464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 488us (3140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581665.160851:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788581665.162907:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e766ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184318464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581665.162947:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b31b6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31b76 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.162963:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b31b6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31b76 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581665.163099:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184318592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581665.163382:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581665.163454:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46d92600 going to sleep for 11 seconds 00000100:00100000:2.0:1788581665.163546:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184318592 00000100:00100000:2.0:1788581665.163556:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184318592 00000100:00100000:2.0:1788581665.163612:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788581665.163623:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:22624:x1875463184318592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581665.164023:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:22624:x1875463184318592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 400us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581665.164033:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788581665.164188:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184318592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581665.164235:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184318720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581665.164659:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581665.164703:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f9963c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581665.164745:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184318720 00000100:00100000:3.0:1788581665.164751:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184318720 00000100:00100000:3.0:1788581665.164791:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788581665.164799:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:22624:x1875463184318720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581665.164901:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:22624:x1875463184318720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581665.164908:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788581665.164997:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184318720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788581665.167071:0:25670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788581665.167249:0:22624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788581665.167305:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581665.167319:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b31b6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31b76 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581665.167334:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e42b0e600/0x50f0cc74b7b31b6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31b76 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581665.167347:0:22624:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788581665.167350:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e6fad9800 from 13 10000000:01000000:1.0:1788581665.167354:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788581665.167400:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a000/0x50f0cc74b7b31b7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581665.167410:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e49e6a000/0x50f0cc74b7b31b7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581665.167422:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e49e6a000/0x50f0cc74b7b31b7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581665.167453:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184318848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788581665.167533:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581665.171019:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f9963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581665.177916:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184318848 00000100:00100000:2.0:1788581665.177942:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184318848 00000100:00100000:2.0:1788581665.178050:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788581665.178073:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+21:22624:x1875463184318848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581665.178096:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581665.178120:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e42b0e400/0x50f0cc74b7b31b84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b31b7d expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.178156:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e42b0e400/0x50f0cc74b7b31b84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b31b7d expref: 22 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.178169:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e42b0e400/0x50f0cc74b7b31b84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31b7d expref: 22 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.178181:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e400, rc 0) 00000100:00100000:2.0:1788581665.178322:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:22624:x1875463184318848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 260us (10788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581665.178330:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788581665.179071:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184318848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581665.179098:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e49e6a000/0x50f0cc74b7b31b7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31b84 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581665.179110:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e49e6a000/0x50f0cc74b7b31b7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31b84 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581665.179240:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184318976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581665.179313:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581665.179362:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f9963c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581665.179457:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184318976 00000100:00100000:0.0:1788581665.179465:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184318976 00000100:00100000:0.0:1788581665.179511:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788581665.179521:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:22624:x1875463184318976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581665.179693:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:22624:x1875463184318976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581665.179702:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788581665.180447:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184318976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581665.180499:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184319104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581665.180563:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581665.180601:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f9963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581665.180969:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184319104 00000100:00100000:2.0:1788581665.180977:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184319104 00000100:00100000:2.0:1788581665.181032:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788581665.181978:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:22624:x1875463184319104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581665.182411:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:22624:x1875463184319104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1368us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581665.182423:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788581665.182464:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184319104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788581665.189643:0:25671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788581665.189867:0:22624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788581665.189901:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581665.189916:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6a000/0x50f0cc74b7b31b7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31b84 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581665.189930:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e49e6a000/0x50f0cc74b7b31b7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31b84 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581665.189942:0:22624:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788581665.189945:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e6be35800 from 13 10000000:01000000:1.0:1788581665.189948:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788581665.190001:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b31b8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581665.190010:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b31b8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581665.190024:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b31b8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581665.190090:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184319232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788581665.190189:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581665.190248:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f9963c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581665.192014:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184319232 00000100:00100000:0.0:1788581665.192033:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184319232 00000100:00100000:0.0:1788581665.192126:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788581665.192139:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+22:22624:x1875463184319232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581665.192160:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581665.192183:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fa71400/0x50f0cc74b7b31b92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b31b8b expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.192218:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fa71400/0x50f0cc74b7b31b92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b31b8b expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.192231:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fa71400/0x50f0cc74b7b31b92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31b8b expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.192243:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71400, rc 0) 00000100:00100000:0.0:1788581665.192361:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:22624:x1875463184319232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (2170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581665.192369:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788581665.195737:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184319232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581665.195780:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b31b8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31b92 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581665.195796:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b31b8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31b92 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581665.195943:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184319360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581665.196038:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581665.196098:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f9963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581665.198755:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184319360 00000100:00100000:2.0:1788581665.198776:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184319360 00000100:00100000:2.0:1788581665.198864:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788581665.198877:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:22624:x1875463184319360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581665.199154:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:22624:x1875463184319360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (3116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581665.199163:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788581665.199399:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184319360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581665.199473:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184319488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581665.199536:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581665.199582:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46d92780 going to sleep for 11 seconds 00000100:00100000:0.0:1788581665.199833:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184319488 00000100:00100000:0.0:1788581665.199840:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184319488 00000100:00100000:0.0:1788581665.199892:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788581665.199901:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e6637cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:22624:x1875463184319488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581665.200019:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e6637cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:22624:x1875463184319488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581665.200037:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788581665.200147:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184319488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788581665.201804:0:25672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788581665.203947:0:22624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788581665.203997:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788581665.204013:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b31b8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31b92 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.204028:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e49e6b800/0x50f0cc74b7b31b8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31b92 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581665.204043:0:22624:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788581665.204047:0:22624:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff995e7f798800 from 13 10000000:01000000:3.0:1788581665.204050:0:22624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581665.204114:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b31b99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.204146:0:22624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b31b99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.204159:0:22624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b31b99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581665.204191:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184319616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581665.204329:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581665.204382:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46d92900 going to sleep for 11 seconds 00000100:00100000:0.0:1788581665.204511:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184319616 00000100:00100000:0.0:1788581665.204522:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184319616 00000100:00100000:0.0:1788581665.204590:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788581665.204602:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7faffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+23:22624:x1875463184319616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581665.204618:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581665.204634:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff995e7fa70800/0x50f0cc74b7b31ba0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x50f0cc74b7b31b99 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.204665:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff995e7fa70800/0x50f0cc74b7b31ba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50f0cc74b7b31b99 expref: 24 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.204677:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff995e7fa70800/0x50f0cc74b7b31ba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50f0cc74b7b31b99 expref: 24 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.204688:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70800, rc 0) 00000100:00100000:0.0:1788581665.204745:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7faffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:22624:x1875463184319616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581665.204753:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788581665.205283:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184319616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581665.205306:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b31b99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31ba0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581665.205318:0:22624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b31b99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50f0cc74b7b31ba0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581665.205403:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184319744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581665.205443:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581665.205487:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f996480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581665.205689:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184319744 00000100:00100000:2.0:1788581665.205697:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184319744 00000100:00100000:2.0:1788581665.205743:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788581665.205761:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:22624:x1875463184319744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581665.205918:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:22624:x1875463184319744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581665.205927:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788581665.208180:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184319744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581665.208299:0:22624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184319872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581665.208401:0:22624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581665.208446:0:22624:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f996480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581665.208523:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184319872 00000100:00100000:3.0:1788581665.208532:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184319872 00000100:00100000:3.0:1788581665.208588:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788581665.208599:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:22624:x1875463184319872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581665.208736:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:22624:x1875463184319872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581665.208745:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788581665.208939:0:22624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d423e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a361c037-f8ee-420d-b76d-dbdb9328e15d:22624:1875463184319872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788581665.209955:0:25673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788581665.210480:0:22624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788581665.210509:0:22624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581665.210523:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b31b99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31ba0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581665.210537:0:22624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff995e6f981e00/0x50f0cc74b7b31b99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50f0cc74b7b31ba0 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581665.306369:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581665.306639:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170583808 00000100:00100000:2.0:1788581665.306653:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170583808 00000100:00100000:2.0:1788581665.306759:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:2.0:1788581665.306773:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+6:18717:x1875463170583808:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581665.306800:0:23963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581665.306831:0:23963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b31ba7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22685 expref: -99 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.306917:0:23963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.306932:0:23963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.306946:0:23963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.306961:0:23963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.306984:0:23963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.306992:0:23963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.307105:0:23963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31bbc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.307114:0:23963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31bbc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.307121:0:23963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31bbc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581665.307156:0:23963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788581665.307161:0:23963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788581665.307207:0:23963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31bbc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.307220:0:23963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.307228:0:23963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.307235:0:23963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.307241:0:23963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581665.307245:0:23963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.307294:0:23963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.307310:0:23963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47aa6f00) 00010000:00010000:2.0:1788581665.307314:0:23963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581665.307319:0:23963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.307325:0:23963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.307342:0:23963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.307348:0:23963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.307355:0:23963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.307360:0:23963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581665.307362:0:23963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.307367:0:23963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.307374:0:23963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff995d4203bb00) 00010000:00010000:2.0:1788581665.307377:0:23963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581665.307379:0:23963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788581665.307705:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788581665.311314:0:23963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.311409:0:23963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b31ba7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22685 expref: 8 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.311432:0:23963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e200/0x50f0cc74b7b31bbc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22685 expref: 7 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.311444:0:23963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff995d4203bd00) 00010000:00010000:2.0:1788581665.311448:0:23963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788581665.311452:0:23963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e42b0e200, rc 0) 00000100:00100000:2.0:1788581665.313013:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+7:18717:x1875463170583808:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 6233us (6647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581665.313026:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:1.0:1788581665.321355:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581665.321459:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170583936 00000100:00100000:0.0:1788581665.321472:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170583936 00000100:00100000:0.0:1788581665.321561:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:0.0:1788581665.321574:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:267202bf-c8d5-4953-b113-02f06afe1645+7:18717:x1875463170583936:12345-192.168.203.3@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788581665.321683:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:267202bf-c8d5-4953-b113-02f06afe1645+7:18717:x1875463170583936:12345-192.168.203.3@tcp:900:lhsmtool_posix.0 Request processed in 111us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581665.321693:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:3.0:1788581665.324339:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581665.325468:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170584192 00000100:00100000:1.0:1788581665.325485:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170584192 00000100:00100000:2.0:1788581665.325729:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:2.0:1788581665.325745:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+7:18717:x1875463170584192:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581665.325773:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581665.325800:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b31bc3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2268c expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.325912:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bca lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.325931:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.325966:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.325984:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bd1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.325990:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.325997:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.326421:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03c00/0x50f0cc74b7b31bd8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.326432:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03c00/0x50f0cc74b7b31bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.326441:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03c00/0x50f0cc74b7b31bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581665.326453:0:22626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788581665.326654:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.326663:0:22626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bca lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.326672:0:22626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.326679:0:22626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0e800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581665.326689:0:22626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.326699:0:22626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bca lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.326714:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff995d4203bd00) 00010000:00010000:2.0:1788581665.326718:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581665.326722:0:22626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.326730:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0e800/0x50f0cc74b7b31bca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.326744:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.326750:0:22626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bd1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.326757:0:22626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.326763:0:22626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e42b0f200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581665.326766:0:22626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.326771:0:22626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bd1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.326777:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff995d4203bb00) 00010000:00010000:2.0:1788581665.326780:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581665.326786:0:22626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bd1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.326793:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f200/0x50f0cc74b7b31bd1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.330337:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e42b0f600/0x50f0cc74b7b31bc3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2268c expref: 10 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.330367:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03c00/0x50f0cc74b7b31bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2268c expref: 9 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.330378:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995d4203b700) 00010000:00010000:2.0:1788581665.330381:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581665.330385:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e46d03c00, rc 0) 00000100:00100000:2.0:1788581665.330849:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+9:18717:x1875463170584192:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 5106us (6522us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788581665.330860:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:1.0:1788581665.338759:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581665.338849:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170584320 00000100:00100000:2.0:1788581665.338867:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170584320 00000100:00100000:2.0:1788581665.338936:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:2.0:1788581665.338947:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d423e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+9:18717:x1875463170584320:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788581665.339141:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d423e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+9:18717:x1875463170584320:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 195us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581665.339149:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:3.0:1788581665.346103:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581665.346234:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170584448 00000100:00100000:2.0:1788581665.346247:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170584448 00000100:00100000:2.0:1788581665.346788:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:2.0:1788581665.346802:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+5:18717:x1875463170584448:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788581665.348614:0:23963:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1725us 00000100:00080000:1.0:1788581665.350956:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788581665.362701:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581665.362880:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170584576 00000100:00100000:2.0:1788581665.362894:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170584576 00000100:00100000:2.0:1788581665.362973:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:2.0:1788581665.362984:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+9:18723:x1875463170584576:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1788581665.363011:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581665.363035:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02600/0x50f0cc74b7b31be6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22693 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.363131:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03000/0x50f0cc74b7b31bed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.363150:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03000/0x50f0cc74b7b31bed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.363164:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03000/0x50f0cc74b7b31bed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.365660:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03400/0x50f0cc74b7b31bf4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.365684:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03400/0x50f0cc74b7b31bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.365698:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03400/0x50f0cc74b7b31bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.365748:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03000/0x50f0cc74b7b31bed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.365773:0:22626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03000/0x50f0cc74b7b31bed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.365780:0:22626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03000/0x50f0cc74b7b31bed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.365786:0:22626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e46d03000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581665.365791:0:22626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03000/0x50f0cc74b7b31bed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.365798:0:22626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03000/0x50f0cc74b7b31bed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.365813:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47aa6f00) 00010000:00010000:2.0:1788581665.365816:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581665.365821:0:22626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03000/0x50f0cc74b7b31bed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.365827:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03000/0x50f0cc74b7b31bed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.365843:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03400/0x50f0cc74b7b31bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.365849:0:22626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03400/0x50f0cc74b7b31bf4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.365854:0:22626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03400/0x50f0cc74b7b31bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.365859:0:22626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e46d03400 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581665.365869:0:22626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03400/0x50f0cc74b7b31bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.365874:0:22626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03400/0x50f0cc74b7b31bf4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.365882:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff995d4203bb00) 00010000:00010000:2.0:1788581665.365884:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581665.365886:0:22626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03400/0x50f0cc74b7b31bf4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.365892:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03400/0x50f0cc74b7b31bf4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.368561:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02600/0x50f0cc74b7b31be6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22693 expref: 10 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.368583:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47aa6f00) 00010000:00010000:2.0:1788581665.368585:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581665.368592:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02600/0x50f0cc74b7b31be6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22693 expref: 10 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.368610:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e46d02600, rc 0) 00000100:00100000:2.0:1788581665.368934:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+9:18723:x1875463170584576:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 5949us (6244us total) trans 0 rc 301/301 00000100:00100000:2.0:1788581665.368945:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:2.0:1788581665.371807:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+5:18717:x1875463170584448:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 24998us (25709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581665.371825:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:3.0:1788581665.378164:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581665.378473:0:22635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170584704 00000100:00100000:0.0:1788581665.378506:0:22635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170584704 00000100:00100000:0.0:1788581665.378589:0:22635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:0.0:1788581665.378601:0:22635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:267202bf-c8d5-4953-b113-02f06afe1645+9:18723:x1875463170584704:12345-192.168.203.3@tcp:700:lfs.0 00000100:00100000:0.0:1788581665.378713:0:22635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:267202bf-c8d5-4953-b113-02f06afe1645+9:18723:x1875463170584704:12345-192.168.203.3@tcp:700:lfs.0 Request processed in 114us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581665.378722:0:22635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:2.0:1788581665.381000:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581665.381108:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170584960 00000100:00100000:3.0:1788581665.381119:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170584960 00000100:00100000:3.0:1788581665.381191:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:3.0:1788581665.381202:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:267202bf-c8d5-4953-b113-02f06afe1645+9:18723:x1875463170584960:12345-192.168.203.3@tcp:36:lfs.0 00010000:00010000:3.0:1788581665.381318:0:25422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581665.381381:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b400/0x50f0cc74b7b31b14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22600 expref: 9 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.381407:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47aa6f00) 00010000:00010000:3.0:1788581665.381413:0:25422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581665.382234:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31bfb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.382281:0:25422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31b53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22670 expref: 5 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.382292:0:25422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31bfb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.382341:0:25422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31b53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22670 expref: 5 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.382430:0:25422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31b53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22670 expref: 5 pid: 23963 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581665.382450:0:25422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43968e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:25422:1875463184320000:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581665.382709:0:25422:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46d92540 going to sleep for 11 seconds 00000100:00100000:3.0:1788581665.388088:0:25422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43968e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:25422:1875463184320000:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581665.388138:0:25422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31bfb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581665.388243:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581665.390032:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170585088 00000100:00100000:3.0:1788581665.390050:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170585088 00010000:00010000:3.0:1788581665.390141:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31b53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22670 expref: 6 pid: 23963 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581665.390207:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:3.0:1788581665.390219:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f130e6e6-d193-4588-a48c-a08395bb01b0+6:2396:x1875463170585088:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581665.390238:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581665.390247:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31b53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22670 expref: 6 pid: 23963 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.390295:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31b53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22670 expref: 6 pid: 23963 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.390325:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31b53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df22670 expref: 6 pid: 23963 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.390345:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47aa6f00) 00010000:00010000:3.0:1788581665.390351:0:22612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31bfb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.390363:0:22612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31bfb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.390372:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31bfb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.390531:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581665.390612:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f130e6e6-d193-4588-a48c-a08395bb01b0+5:2396:x1875463170585088:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 393us (2370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581665.390621:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00080000:1.0:1788581665.391528:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788581665.396227:0:25422:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31bfb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.396251:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31bfb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.396331:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b31c02 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.396356:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b31c02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.396373:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b31c02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.414150:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b31c09 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.414174:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b31c09 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.414185:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b31c09 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581665.414201:0:25422:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b114e59a reply state 000000001ea83b4d transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b31c09 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.414219:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b31c09 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.414226:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff995d4203ae00) 00010000:00010000:0.0:1788581665.414229:0:25422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788581665.414233:0:25422:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788581665.414238:0:25422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788581665.414246:0:25422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31bfb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.414297:0:25422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31bfb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.414304:0:25422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31bfb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.414310:0:25422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981a00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581665.414314:0:25422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31bfb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.414321:0:25422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31bfb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.414331:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e47aa6f00) 00010000:00010000:0.0:1788581665.414333:0:25422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581665.414337:0:25422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31bfb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.414342:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31bfb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581665.414385:0:25422:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b114e59a reply state 000000001ea83b4d transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b31c02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.414394:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b31c02 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.414401:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff995d4203ab00) 00010000:00010000:0.0:1788581665.414403:0:25422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788581665.414405:0:25422:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788581665.414644:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:267202bf-c8d5-4953-b113-02f06afe1645+10:18723:x1875463170584960:12345-192.168.203.3@tcp:36:lfs.0 Request processed in 33297us (33509us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788581665.414654:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 00000040:00080000:1.0:1788581665.474022:0:22661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788581665.528877:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581665.528972:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170585216 00000100:00100000:3.0:1788581665.528996:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170585216 00000100:00100000:3.0:1788581665.529096:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:3.0:1788581665.529107:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+10:18731:x1875463170585216:12345-192.168.203.3@tcp:101:lctl.0 00010000:00010000:3.0:1788581665.529130:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581665.529153:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31c10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2269a expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.529230:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b31c17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.529245:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b31c17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.529289:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b31c17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581665.529336:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788581665.529340:0:22628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788581665.529379:0:22628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b31c17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.529403:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31c10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2269a expref: 12 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.529422:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981200/0x50f0cc74b7b31c17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2269a expref: 11 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.529430:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6f925700) 00010000:00010000:3.0:1788581665.529433:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581665.529436:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981200, rc 0) 00000100:00100000:3.0:1788581665.529518:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+11:18731:x1875463170585216:12345-192.168.203.3@tcp:101:lctl.0 Request processed in 412us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581665.529526:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:2.0:1788581665.562419:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581665.563546:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170585344 00000100:00100000:0.0:1788581665.563560:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170585344 00000100:00100000:0.0:1788581665.563691:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:0.0:1788581665.563703:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f130e6e6-d193-4588-a48c-a08395bb01b0+5:18732:x1875463170585344:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581665.563725:0:23963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581665.563745:0:23963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b31c1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df226a1 expref: -99 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.563811:0:23963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b31c25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.563826:0:23963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b31c25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.563839:0:23963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b31c25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581665.563908:0:23963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788581665.563912:0:23963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581665.563933:0:23963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b31c25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.563960:0:23963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b31c1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226a1 expref: 7 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.563980:0:23963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71200/0x50f0cc74b7b31c25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226a1 expref: 6 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.563989:0:23963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6f925700) 00010000:00010000:0.0:1788581665.563992:0:23963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581665.563996:0:23963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71200, rc 0) 00000100:00100000:0.0:1788581665.564072:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f130e6e6-d193-4588-a48c-a08395bb01b0+6:18732:x1875463170585344:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 362us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581665.564080:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:0.0:1788581665.566655:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581665.566885:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170585472 00000100:00100000:3.0:1788581665.566895:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170585472 00000100:00100000:3.0:1788581665.566959:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:3.0:1788581665.566969:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f130e6e6-d193-4588-a48c-a08395bb01b0+6:18732:x1875463170585472:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1788581665.566992:0:25422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581665.567013:0:25422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31c2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df226a8 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567088:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567102:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567112:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567123:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567130:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567136:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567227:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b31c41 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567249:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b31c41 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567290:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b31c41 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581665.567330:0:25422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788581665.567333:0:25422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788581665.567354:0:25422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b31c41 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567366:0:25422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567372:0:25422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c33 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567380:0:25422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567386:0:25422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581665.567390:0:25422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567397:0:25422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567408:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6f925700) 00010000:00010000:3.0:1788581665.567411:0:25422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581665.567415:0:25422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567431:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567445:0:25422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567452:0:25422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567458:0:25422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567464:0:25422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581665.567467:0:25422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567473:0:25422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567481:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff995d4203ab00) 00010000:00010000:3.0:1788581665.567484:0:25422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581665.567487:0:25422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567493:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567520:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31c2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226a8 expref: 8 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567650:0:25422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b31c41 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226a8 expref: 7 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.567666:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff995d4203ae00) 00010000:00010000:3.0:1788581665.567668:0:25422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581665.567671:0:25422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981400, rc 0) 00000100:00100000:3.0:1788581665.567741:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f130e6e6-d193-4588-a48c-a08395bb01b0+7:18732:x1875463170585472:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 772us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581665.567748:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:2.0:1788581665.569915:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581665.569996:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170585600 00000100:00100000:0.0:1788581665.570006:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170585600 00000100:00100000:0.0:1788581665.570081:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:0.0:1788581665.570092:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f130e6e6-d193-4588-a48c-a08395bb01b0+5:18732:x1875463170585600:12345-192.168.203.3@tcp:900:lfs.0 00000100:00100000:0.0:1788581665.570169:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f130e6e6-d193-4588-a48c-a08395bb01b0+5:18732:x1875463170585600:12345-192.168.203.3@tcp:900:lfs.0 Request processed in 79us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581665.570184:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00080000:1.0:1788581665.570697:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788581665.578547:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581665.578640:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170585856 00000100:00100000:3.0:1788581665.578649:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170585856 00000100:00100000:3.0:1788581665.578701:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:3.0:1788581665.578710:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f130e6e6-d193-4588-a48c-a08395bb01b0+7:18732:x1875463170585856:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1788581665.578729:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581665.578746:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31c48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df226af expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581665.578831:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788581665.578927:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31c48 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226af expref: 9 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.578941:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6f925700) 00010000:00010000:3.0:1788581665.578944:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581665.578949:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31c48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226af expref: 9 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.578962:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981a00, rc 0) 00000100:00100000:3.0:1788581665.579021:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f130e6e6-d193-4588-a48c-a08395bb01b0+8:18732:x1875463170585856:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 311us (482us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1788581665.579037:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:2.0:1788581665.582920:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581665.583004:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170586112 00000100:00100000:0.0:1788581665.583014:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170586112 00000100:00100000:0.0:1788581665.583075:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:0.0:1788581665.583084:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f130e6e6-d193-4588-a48c-a08395bb01b0+8:18732:x1875463170586112:12345-192.168.203.3@tcp:36:lfs.0 00010000:00010000:0.0:1788581665.583137:0:23963:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581665.583162:0:23963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981400/0x50f0cc74b7b31c41 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226a8 expref: 8 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.583181:0:23963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff995d4203ae00) 00010000:00010000:0.0:1788581665.583185:0:23963:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581665.583208:0:23963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b31c56 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.583221:0:23963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b31c56 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.583230:0:23963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b31c56 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581665.583442:0:23963:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc588721 reply state 000000004c6c5781 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b31c56 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.583456:0:23963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b31c56 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.583462:0:23963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff995d4203ae00) 00010000:00010000:0.0:1788581665.583464:0:23963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788581665.583467:0:23963:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788581665.583473:0:23963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788581665.583822:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f130e6e6-d193-4588-a48c-a08395bb01b0+9:18732:x1875463170586112:12345-192.168.203.3@tcp:36:lfs.0 Request processed in 735us (906us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788581665.583847:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:2.0:1788581665.585619:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581665.585696:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170586368 00000100:00100000:0.0:1788581665.585707:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170586368 00000100:00100000:0.0:1788581665.585762:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:0.0:1788581665.585772:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f130e6e6-d193-4588-a48c-a08395bb01b0+9:18732:x1875463170586368:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1788581665.585971:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f130e6e6-d193-4588-a48c-a08395bb01b0+10:18732:x1875463170586368:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 200us (359us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788581665.585980:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:2.0:1788581665.590076:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581665.590163:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170586624 00000100:00100000:3.0:1788581665.590172:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170586624 00000100:00100000:3.0:1788581665.590227:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:3.0:1788581665.590237:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f130e6e6-d193-4588-a48c-a08395bb01b0+10:18732:x1875463170586624:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1788581665.590306:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581665.590327:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31c5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df226b6 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590401:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590415:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590425:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590436:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590443:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590450:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581665.590549:0:22626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788581665.590629:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590657:0:22626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c64 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590664:0:22626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590669:0:22626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581665.590674:0:22626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590681:0:22626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590695:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6f925700) 00010000:00010000:3.0:1788581665.590698:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581665.590703:0:22626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590708:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31c64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590723:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590729:0:22626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590735:0:22626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590740:0:22626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581665.590749:0:22626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590756:0:22626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590764:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff995d4203ab00) 00010000:00010000:3.0:1788581665.590767:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581665.590770:0:22626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590775:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31c6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590807:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31c5d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226b6 expref: 12 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590816:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6f925700) 00010000:00010000:3.0:1788581665.590818:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581665.590821:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31c5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226b6 expref: 12 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.590830:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981a00, rc 0) 00000100:00100000:3.0:1788581665.590881:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f130e6e6-d193-4588-a48c-a08395bb01b0+11:18732:x1875463170586624:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 646us (824us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1788581665.590888:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00000040:00080000:1.0:1788581665.602113:0:23380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788581665.603415:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581665.604534:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170586752 00000100:00100000:1.0:1788581665.604546:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170586752 00000100:00100000:1.0:1788581665.604613:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:1.0:1788581665.604624:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f130e6e6-d193-4588-a48c-a08395bb01b0+11:18732:x1875463170586752:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1788581665.604665:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581665.604686:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b31c79 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df226bd expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581665.604797:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31c80 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581665.604812:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31c80 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581665.604824:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31c80 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581665.604848:0:22627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788581665.604852:0:22627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788581665.604873:0:22627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31c80 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581665.604911:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b31c79 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226bd expref: 13 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581665.604931:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31c80 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226bd expref: 12 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581665.604940:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff995d4203ae00) 00010000:00010000:1.0:1788581665.604943:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581665.604946:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b600, rc 0) 00000100:00100000:1.0:1788581665.605010:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f130e6e6-d193-4588-a48c-a08395bb01b0+12:18732:x1875463170586752:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 388us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581665.605017:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:0.0:1788581665.615166:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581665.615395:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170586880 00000100:00100000:1.0:1788581665.615405:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170586880 00000100:00100000:1.0:1788581665.615460:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:1.0:1788581665.615471:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f130e6e6-d193-4588-a48c-a08395bb01b0+12:18732:x1875463170586880:12345-192.168.203.3@tcp:37:lfs.0 00000100:00100000:1.0:1788581665.625631:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f130e6e6-d193-4588-a48c-a08395bb01b0+12:18732:x1875463170586880:12345-192.168.203.3@tcp:37:lfs.0 Request processed in 10151us (10465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581665.625645:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:2.0:1788581665.636349:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581665.636451:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170587136 00000100:00100000:0.0:1788581665.636463:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170587136 00000100:00100000:0.0:1788581665.636532:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:0.0:1788581665.636543:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e50d0ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f130e6e6-d193-4588-a48c-a08395bb01b0+12:18732:x1875463170587136:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1788581665.636761:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e50d0ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f130e6e6-d193-4588-a48c-a08395bb01b0+13:18732:x1875463170587136:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 218us (421us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788581665.636769:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:0.0:1788581665.707138:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581665.707292:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170587264 00000100:00100000:2.0:1788581665.707302:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170587264 00000100:00100000:2.0:1788581665.707368:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:2.0:1788581665.707379:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+11:18738:x1875463170587264:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1788581665.707399:0:23963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581665.707416:0:23963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03600/0x50f0cc74b7b31c87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df226c4 expref: -99 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.707482:0:23963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31c8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.707496:0:23963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31c8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.707507:0:23963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31c8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.707520:0:23963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03e00/0x50f0cc74b7b31c95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.707542:0:23963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03e00/0x50f0cc74b7b31c95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.707550:0:23963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03e00/0x50f0cc74b7b31c95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.707631:0:23963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02200/0x50f0cc74b7b31c9c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.707641:0:23963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02200/0x50f0cc74b7b31c9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.707648:0:23963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02200/0x50f0cc74b7b31c9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581665.707901:0:23963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788581665.707906:0:23963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788581665.707947:0:23963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02200/0x50f0cc74b7b31c9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.707959:0:23963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31c8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.707966:0:23963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31c8e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.707973:0:23963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31c8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.707979:0:23963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e46d03a00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581665.707983:0:23963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31c8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.707998:0:23963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31c8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.708010:0:23963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6f925700) 00010000:00010000:2.0:1788581665.708013:0:23963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581665.708018:0:23963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31c8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.708024:0:23963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31c8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.708038:0:23963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03e00/0x50f0cc74b7b31c95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.708044:0:23963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03e00/0x50f0cc74b7b31c95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.708051:0:23963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03e00/0x50f0cc74b7b31c95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.708056:0:23963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e46d03e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581665.708068:0:23963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03e00/0x50f0cc74b7b31c95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.708074:0:23963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03e00/0x50f0cc74b7b31c95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.708081:0:23963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff995d4203ab00) 00010000:00010000:2.0:1788581665.708083:0:23963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581665.708095:0:23963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03e00/0x50f0cc74b7b31c95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.708111:0:23963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03e00/0x50f0cc74b7b31c95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.708139:0:23963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03600/0x50f0cc74b7b31c87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226c4 expref: 13 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.708152:0:23963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02200/0x50f0cc74b7b31c9c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226c4 expref: 12 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.708159:0:23963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff995d4203ae00) 00010000:00010000:2.0:1788581665.708162:0:23963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788581665.708164:0:23963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e46d02200, rc 0) 00000100:00100000:2.0:1788581665.708225:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+12:18738:x1875463170587264:12345-192.168.203.3@tcp:101:bash.0 Request processed in 848us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581665.708233:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:2.0:1788581665.716082:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581665.716303:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170587392 00000100:00100000:0.0:1788581665.716313:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170587392 00000100:00100000:0.0:1788581665.716371:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:0.0:1788581665.716381:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:267202bf-c8d5-4953-b113-02f06afe1645+5:18738:x1875463170587392:12345-192.168.203.3@tcp:900:bash.0 00000100:00100000:0.0:1788581665.716463:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:267202bf-c8d5-4953-b113-02f06afe1645+5:18738:x1875463170587392:12345-192.168.203.3@tcp:900:bash.0 Request processed in 83us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581665.716471:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:0.0:1788581665.722690:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581665.722868:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170587648 00000100:00100000:2.0:1788581665.722878:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170587648 00000100:00100000:2.0:1788581665.722937:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:2.0:1788581665.722948:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+12:18738:x1875463170587648:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1788581665.722967:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581665.722986:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03e00/0x50f0cc74b7b31ca3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df226cb expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.723117:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31caa lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.723145:0:22628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31c80 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226bd expref: 12 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.723154:0:22628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31caa lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.723187:0:22628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31c80 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226bd expref: 12 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.723201:0:22628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31c80 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226bd expref: 12 pid: 22627 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581665.723216:0:22628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45db7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22628:1875463184320128:192.168.203.3@tcp:104: 00000100:00100000:2.0:1788581665.723338:0:22628:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e50a5f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581665.729735:0:22628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45db7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22628:1875463184320128:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581665.729768:0:22628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31caa lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581665.736968:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581665.737182:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170587776 00000100:00100000:3.0:1788581665.737193:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170587776 00010000:00010000:3.0:1788581665.737230:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31c80 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226bd expref: 13 pid: 22627 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581665.737336:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1788581665.737348:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f130e6e6-d193-4588-a48c-a08395bb01b0+13:2394:x1875463170587776:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581665.737362:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581665.737369:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31c80 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226bd expref: 13 pid: 22627 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.737382:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31c80 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226bd expref: 13 pid: 22627 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.737402:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31c80 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226bd expref: 13 pid: 22627 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.737417:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff995d4203ae00) 00010000:00010000:3.0:1788581665.737423:0:22613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31caa lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.737433:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31caa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.737441:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31caa lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581665.737473:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581665.737549:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f130e6e6-d193-4588-a48c-a08395bb01b0+12:2394:x1875463170587776:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 202us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581665.737557:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00010000:00010000:2.0:1788581665.744083:0:22628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31caa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.744103:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31caa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.744558:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02c00/0x50f0cc74b7b31cb1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.744574:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02c00/0x50f0cc74b7b31cb1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.744585:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02c00/0x50f0cc74b7b31cb1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.745111:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31cb8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.745122:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31cb8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.745129:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31cb8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581665.745140:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788581665.745164:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31caa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.745170:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31caa lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.745177:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31caa lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.745182:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e46d03a00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581665.745185:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31caa lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.745192:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31caa lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.745203:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff995d4203ae00) 00010000:00010000:2.0:1788581665.745205:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581665.745209:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31caa lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.745225:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03a00/0x50f0cc74b7b31caa lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581665.745238:0:22628:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2c4cff3 reply state 00000000217c7237 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02c00/0x50f0cc74b7b31cb1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.745247:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02c00/0x50f0cc74b7b31cb1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.745288:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff995d4203bb00) 00010000:00010000:2.0:1788581665.745291:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788581665.745295:0:22628:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788581665.745331:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03e00/0x50f0cc74b7b31ca3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226cb expref: 15 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.745346:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31cb8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226cb expref: 14 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581665.745353:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:2.0:1788581665.745355:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788581665.745358:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e46d03200, rc 0) 00000100:00100000:2.0:1788581665.745425:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+15:18738:x1875463170587648:12345-192.168.203.3@tcp:101:bash.0 Request processed in 22479us (22751us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788581665.745434:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:0.0:1788581665.767647:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581665.769689:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170587904 00000100:00100000:3.0:1788581665.769706:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170587904 00000100:00100000:0.0:1788581665.776138:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:0.0:1788581665.776155:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:267202bf-c8d5-4953-b113-02f06afe1645+15:18738:x1875463170587904:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1788581665.776183:0:25422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581665.776206:0:25422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31cc6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df226d2 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.776294:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31ccd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.776308:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31ccd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.776319:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31ccd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581665.776363:0:25422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788581665.776367:0:25422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581665.776387:0:25422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31ccd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.776398:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31ccd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.776422:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31cc6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226d2 expref: 17 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.776441:0:25422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31ccd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226d2 expref: 16 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.776485:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:0.0:1788581665.776488:0:25422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581665.776491:0:25422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70a00, rc 0) 00000100:00100000:0.0:1788581665.778156:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:267202bf-c8d5-4953-b113-02f06afe1645+16:18738:x1875463170587904:12345-192.168.203.3@tcp:101:bash.0 Request processed in 1993us (10506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581665.778167:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:2.0:1788581665.803610:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581665.803705:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170588160 00000100:00100000:1.0:1788581665.803715:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170588160 00000100:00100000:1.0:1788581665.803772:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:1.0:1788581665.803782:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:267202bf-c8d5-4953-b113-02f06afe1645+16:18738:x1875463170588160:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:1.0:1788581665.804103:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:267202bf-c8d5-4953-b113-02f06afe1645+17:18738:x1875463170588160:12345-192.168.203.3@tcp:35:bash.0 Request processed in 321us (504us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788581665.804112:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:2.0:1788581665.946691:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581665.947246:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170588416 00000100:00100000:0.0:1788581665.947304:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170588416 00000100:00100000:0.0:1788581665.947367:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:0.0:1788581665.947379:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+17:18748:x1875463170588416:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1788581665.947406:0:23963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581665.947430:0:23963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31cd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df226d9 expref: -99 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581665.947544:0:23963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788581665.947641:0:23963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31cd4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226d9 expref: 19 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.947656:0:23963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff995e6f925700) 00010000:00010000:0.0:1788581665.947658:0:23963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581665.947663:0:23963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31cd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226d9 expref: 19 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581665.947675:0:23963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71600, rc 0) 00000100:00100000:0.0:1788581665.947772:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+18:18748:x1875463170588416:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 394us (1090us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1788581665.947798:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:2.0:1788581665.954869:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581665.955091:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170588672 00000100:00100000:1.0:1788581665.955101:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170588672 00000100:00100000:1.0:1788581665.955152:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:1.0:1788581665.955162:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:267202bf-c8d5-4953-b113-02f06afe1645+18:18748:x1875463170588672:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:1.0:1788581665.955834:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:267202bf-c8d5-4953-b113-02f06afe1645+19:18748:x1875463170588672:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 668us (970us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788581665.955843:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:3.0:1788581666.035000:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581666.035121:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170588928 00000100:00100000:2.0:1788581666.035153:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170588928 00000100:00100000:2.0:1788581666.035213:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:2.0:1788581666.035223:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+19:18751:x1875463170588928:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1788581666.035247:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581666.035293:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02800/0x50f0cc74b7b31ce2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df226e0 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.035399:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03800/0x50f0cc74b7b31ce9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.035414:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03800/0x50f0cc74b7b31ce9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.035427:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03800/0x50f0cc74b7b31ce9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581666.035438:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788581666.035553:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02800/0x50f0cc74b7b31ce2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226e0 expref: 22 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.035572:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03800/0x50f0cc74b7b31ce9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226e0 expref: 21 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.035581:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:2.0:1788581666.035584:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581666.035587:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e46d03800, rc 0) 00000100:00100000:2.0:1788581666.035654:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+21:18751:x1875463170588928:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 432us (663us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788581666.035661:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:2.0:1788581666.042177:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581666.042310:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170589056 00000100:00100000:0.0:1788581666.042321:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170589056 00000100:00100000:0.0:1788581666.042375:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:0.0:1788581666.042386:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:267202bf-c8d5-4953-b113-02f06afe1645+21:18751:x1875463170589056:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:0.0:1788581666.042458:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31cf7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.042475:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31cf7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.042489:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31cf7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.042523:0:25422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31cf7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.042530:0:25422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31cf7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.042537:0:25422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31cf7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.042543:0:25422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581666.042547:0:25422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31cf7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.042554:0:25422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31cf7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.042565:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:0.0:1788581666.042578:0:25422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581666.042584:0:25422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31cf7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.042590:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31cf7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581666.042664:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:267202bf-c8d5-4953-b113-02f06afe1645+21:18751:x1875463170589056:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 279us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581666.042671:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:3.0:1788581666.043601:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581666.043817:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170589184 00000100:00100000:2.0:1788581666.043824:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170589184 00000100:00100000:2.0:1788581666.044318:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:2.0:1788581666.044333:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:267202bf-c8d5-4953-b113-02f06afe1645+21:2395:x1875463170589184:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581666.044349:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581666.044372:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03800/0x50f0cc74b7b31ce9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226e0 expref: 21 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.044390:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:2.0:1788581666.044394:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581666.044446:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:267202bf-c8d5-4953-b113-02f06afe1645+20:2395:x1875463170589184:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 118us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581666.044453:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:3.0:1788581666.048642:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581666.049079:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170589440 00000100:00100000:0.0:1788581666.049093:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170589440 00000100:00100000:0.0:1788581666.049150:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:0.0:1788581666.049161:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:267202bf-c8d5-4953-b113-02f06afe1645+20:18751:x1875463170589440:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1788581666.049413:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:267202bf-c8d5-4953-b113-02f06afe1645+21:18751:x1875463170589440:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 253us (777us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1788581666.049422:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00010000:00010000:2.0:1788581666.050418:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581666.360207:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581666.360440:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170589696 00000100:00100000:3.0:1788581666.360452:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170589696 00000100:00100000:3.0:1788581666.360515:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:3.0:1788581666.360526:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267202bf-c8d5-4953-b113-02f06afe1645+21:18782:x1875463170589696:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:3.0:1788581666.360550:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581666.360571:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31cfe lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df226e7 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.360683:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d05 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.360698:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.360711:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581666.360722:0:22627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788581666.361001:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31cfe lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226e7 expref: 24 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.361020:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d05 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226e7 expref: 23 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.361043:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:3.0:1788581666.361046:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581666.361050:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981000, rc 0) 00000100:00100000:3.0:1788581666.361212:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267202bf-c8d5-4953-b113-02f06afe1645+23:18782:x1875463170589696:12345-192.168.203.3@tcp:101:cat.0 Request processed in 686us (1013us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1788581666.361220:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:2.0:1788581666.368364:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581666.368416:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581666.368586:0:24158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170590080 00000100:00100000:3.0:1788581666.368596:0:24158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170590080 00000100:00100000:3.0:1788581666.368669:0:24158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:3.0:1788581666.368679:0:24158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:267202bf-c8d5-4953-b113-02f06afe1645+23:2394:x1875463170590080:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581666.368694:0:24158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581666.368720:0:24158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d05 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226e7 expref: 23 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.368739:0:24158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:3.0:1788581666.368743:0:24158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581666.368901:0:24158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:267202bf-c8d5-4953-b113-02f06afe1645+22:2394:x1875463170590080:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 223us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581666.368909:0:24158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:0.0:1788581666.368976:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170589952 00000100:00100000:0.0:1788581666.368981:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170589952 00000100:00100000:0.0:1788581666.369018:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:0.0:1788581666.369026:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:267202bf-c8d5-4953-b113-02f06afe1645+22:18782:x1875463170589952:12345-192.168.203.3@tcp:35:cat.0 00000100:00100000:0.0:1788581666.369499:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:267202bf-c8d5-4953-b113-02f06afe1645+23:18782:x1875463170589952:12345-192.168.203.3@tcp:35:cat.0 Request processed in 471us (1142us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1788581666.369507:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:0.0:1788581666.447819:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581666.447933:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170590336 00000100:00100000:3.0:1788581666.447953:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170590336 00000100:00100000:3.0:1788581666.448052:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:3.0:1788581666.448074:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+23:18788:x1875463170590336:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:3.0:1788581666.448111:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581666.448140:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d13 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df226ee expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.448346:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31d1a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.448365:0:22626:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31cb8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226cb expref: 24 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.448387:0:22626:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31ccd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226d2 expref: 24 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.448395:0:22626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31d1a lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.448450:0:22626:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31ccd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226d2 expref: 24 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.448468:0:22626:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31ccd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226d2 expref: 24 pid: 25422 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581666.448499:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22626:1875463184320256:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581666.448633:0:22626:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31cb8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226cb expref: 24 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.448643:0:22626:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31cb8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226cb expref: 24 pid: 22628 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581666.448652:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43969880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22626:1875463184320384:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581666.448691:0:22626:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46d926c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581666.451325:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22626:1875463184320256:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581666.451344:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43969880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22626:1875463184320384:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581666.451378:0:22626:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31d1a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581666.451765:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581666.451807:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581666.451891:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170590464 00000100:00100000:2.0:1788581666.451901:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170590464 00010000:00010000:2.0:1788581666.451951:0:22614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31ccd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226d2 expref: 25 pid: 25422 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581666.451997:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170590592 00000100:00100000:2.0:1788581666.452001:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170590592 00010000:00010000:2.0:1788581666.452015:0:22614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31cb8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226cb expref: 26 pid: 22628 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581666.452044:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:2.0:1788581666.452064:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:267202bf-c8d5-4953-b113-02f06afe1645+26:2395:x1875463170590464:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581666.452104:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581666.452113:0:22614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31ccd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226d2 expref: 26 pid: 25422 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.452127:0:22614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31ccd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226d2 expref: 26 pid: 25422 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.452156:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31ccd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226d2 expref: 26 pid: 25422 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.452177:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:2.0:1788581666.452183:0:22614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31d1a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581666.452194:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00010000:00010000:2.0:1788581666.452201:0:22614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31d1a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.452210:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581666.452237:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7b536050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:267202bf-c8d5-4953-b113-02f06afe1645+25:2395:x1875463170590592:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788581666.452335:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:267202bf-c8d5-4953-b113-02f06afe1645+25:2395:x1875463170590464:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 279us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581666.452344:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00010000:00010000:1.0:1788581666.453470:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581666.453503:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31cb8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226cb expref: 24 pid: 22628 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.453521:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31cb8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226cb expref: 24 pid: 22628 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.453543:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31cb8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226cb expref: 24 pid: 22628 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.453563:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:1.0:1788581666.453568:0:22613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31d1a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.453578:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31d1a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.453587:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31d1a lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.453622:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581666.453699:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7b536050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:267202bf-c8d5-4953-b113-02f06afe1645+23:2395:x1875463170590592:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1489us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581666.453711:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00010000:00010000:3.0:1788581666.453749:0:22626:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31d1a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.453765:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31d1a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581666.453799:0:22626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788581666.454023:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d13 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226ee expref: 24 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.454044:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981a00/0x50f0cc74b7b31d1a lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226ee expref: 23 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.454061:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:3.0:1788581666.454064:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788581666.454067:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981a00, rc 0) 00000100:00100000:3.0:1788581666.454117:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+23:18788:x1875463170590336:12345-192.168.203.3@tcp:101:dd.0 Request processed in 6045us (6308us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1788581666.454126:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:0.0:1788581666.458371:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581666.458738:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170590720 00000100:00100000:2.0:1788581666.458749:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170590720 00000100:00100000:2.0:1788581666.458806:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:2.0:1788581666.458817:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+23:18788:x1875463170590720:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:2.0:1788581666.458840:0:23963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581666.458860:0:23963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02400/0x50f0cc74b7b31d28 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df226f5 expref: -99 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.458908:0:23963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02a00/0x50f0cc74b7b31d2f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.458923:0:23963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02a00/0x50f0cc74b7b31d2f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.458934:0:23963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02a00/0x50f0cc74b7b31d2f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.459048:0:23963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02400/0x50f0cc74b7b31d28 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226f5 expref: 25 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.459080:0:23963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02a00/0x50f0cc74b7b31d2f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226f5 expref: 24 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.459090:0:23963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:2.0:1788581666.459093:0:23963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788581666.459097:0:23963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e46d02a00, rc 0) 00000100:00100000:2.0:1788581666.459173:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+24:18788:x1875463170590720:12345-192.168.203.3@tcp:101:dd.0 Request processed in 358us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581666.459180:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:2.0:1788581666.464352:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581666.464680:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170590976 00000100:00100000:3.0:1788581666.464695:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170590976 00000100:00100000:3.0:1788581666.464841:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:3.0:1788581666.464874:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+24:18788:x1875463170590976:12345-192.168.203.3@tcp:36:dd.0 00010000:00010000:3.0:1788581666.465208:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d36 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.465230:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d36 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.465244:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d36 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788581666.465339:0:22628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1788581666.465366:0:22628:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041625bfa reply state 00000000ae36a918 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d36 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.465380:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d36 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.465388:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:3.0:1788581666.465391:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788581666.465396:0:22628:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788581666.466065:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+27:18788:x1875463170590976:12345-192.168.203.3@tcp:36:dd.0 Request processed in 1182us (1717us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1788581666.466075:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00000020:00080000:3.0:1788581666.466082:0:22628:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788581666.473122:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581666.473746:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170591104 00000100:00100000:3.0:1788581666.473762:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170591104 00000100:00100000:3.0:1788581666.473895:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:3.0:1788581666.473908:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+27:18788:x1875463170591104:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:3.0:1788581666.473942:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581666.473971:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31d3d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df226fc expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.474093:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31d3d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226fc expref: 28 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.474111:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31d3d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226fc expref: 28 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.474134:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:3.0:1788581666.474138:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581666.474143:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980c00, rc 0) 00000100:00100000:3.0:1788581666.474241:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+28:18788:x1875463170591104:12345-192.168.203.3@tcp:101:dd.0 Request processed in 335us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581666.474248:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:1.0:1788581666.488960:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581666.489115:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170591360 00000100:00100000:2.0:1788581666.489129:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170591360 00000100:00100000:2.0:1788581666.489787:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:2.0:1788581666.489804:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e766ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:267202bf-c8d5-4953-b113-02f06afe1645+28:18788:x1875463170591360:12345-192.168.203.3@tcp:103:dd.0 00010000:00010000:2.0:1788581666.489826:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581666.489884:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980c00/0x50f0cc74b7b31d3d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226fc expref: 28 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.489909:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:2.0:1788581666.489915:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581666.490048:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e766ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:267202bf-c8d5-4953-b113-02f06afe1645+27:18788:x1875463170591360:12345-192.168.203.3@tcp:103:dd.0 Request processed in 249us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581666.490066:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:1.0:1788581666.492901:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581666.493006:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170591488 00000100:00100000:3.0:1788581666.493018:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170591488 00000100:00100000:3.0:1788581666.493103:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:3.0:1788581666.493116:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267202bf-c8d5-4953-b113-02f06afe1645+27:18788:x1875463170591488:12345-192.168.203.3@tcp:58:dd.0 00010000:00010000:3.0:1788581666.493319:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b31d44 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.493341:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b31d44 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.493354:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b31d44 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788581666.494631:0:22627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581666.494672:0:22627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1788581666.494817:0:22627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1788581666.495007:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267202bf-c8d5-4953-b113-02f06afe1645+27:18788:x1875463170591488:12345-192.168.203.3@tcp:58:dd.0 Request processed in 1885us (2110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581666.495020:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 47 00000040:00080000:2.0:1788581666.498009:0:22661:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788581666.498024:0:22661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788581666.498068:0:22661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788581666.498078:0:22661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788581666.498293:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e45db6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22661:1875463184320512:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788581666.498406:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e450fd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581666.501680:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581666.502788:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170591616 00000100:00100000:3.0:1788581666.502804:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170591616 00000100:00100000:3.0:1788581666.502886:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:3.0:1788581666.502899:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+28:18788:x1875463170591616:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:3.0:1788581666.502927:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581666.502954:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b31d4b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22703 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.503027:0:22628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b31d44 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.503040:0:22628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b31d4b lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22703 expref: 29 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.503074:0:22628:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b31d44 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.503090:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b31d4b lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22703 expref: 29 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.503106:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:3.0:1788581666.503109:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581666.503113:0:22628:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b31d4b lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22703 expref: 29 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.503143:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981600, rc 0) 00000100:00100000:3.0:1788581666.503400:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+29:18788:x1875463170591616:12345-192.168.203.3@tcp:101:dd.0 Request processed in 502us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581666.503408:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:2.0:1788581666.504413:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e45db6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22661:1875463184320512:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788581666.506851:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581666.506957:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170591744 00000100:00100000:3.0:1788581666.506970:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170591744 00000100:00100000:3.0:1788581666.507082:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:3.0:1788581666.507094:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+28:18789:x1875463170591744:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788581666.507137:0:22626:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788581666.507339:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+28:18789:x1875463170591744:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 246us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581666.507348:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:0.0:1788581666.512909:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581666.513015:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170591872 00000100:00100000:3.0:1788581666.513028:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170591872 00000100:00100000:3.0:1788581666.513108:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:3.0:1788581666.513120:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267202bf-c8d5-4953-b113-02f06afe1645+28:18789:x1875463170591872:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788581666.513218:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31d52 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513240:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31d52 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513282:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31d52 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513603:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b31d59 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513630:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b31d59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513638:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b31d59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513668:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b31d60 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513678:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b31d60 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513684:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b31d60 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581666.513749:0:22627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788581666.513754:0:22627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788581666.513774:0:22627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b31d60 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513787:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31d52 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513794:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31d52 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513801:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31d52 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513807:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581666.513812:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31d52 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513828:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31d52 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513844:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995d4203b700) 00010000:00010000:3.0:1788581666.513847:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581666.513853:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31d52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513859:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31d52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513876:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b31d59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513883:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b31d59 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513889:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b31d59 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513894:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980a00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581666.513897:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b31d59 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513903:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b31d59 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513910:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff995e6f925800) 00010000:00010000:3.0:1788581666.513912:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581666.513915:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b31d59 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513931:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b31d59 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513948:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b31d60 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513954:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b31d60 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513960:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b31d60 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513965:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981800 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581666.513968:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b31d60 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513974:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b31d60 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513981:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:3.0:1788581666.513983:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581666.513986:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b31d60 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.513992:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b31d60 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581666.514174:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267202bf-c8d5-4953-b113-02f06afe1645+28:18789:x1875463170591872:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 Request processed in 1051us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581666.514184:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:2.0:1788581666.517139:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581666.517372:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170592128 00000100:00100000:0.0:1788581666.517387:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170592128 00000100:00100000:0.0:1788581666.517617:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:0.0:1788581666.517633:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+28:18789:x1875463170592128:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581666.517665:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581666.517693:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b31d67 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2270a expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.517836:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b31d6e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.517854:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b31d6e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.517867:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b31d6e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581666.517879:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788581666.517984:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b31d6e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.517992:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b31d6e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.517999:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b31d6e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.518005:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581666.518010:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b31d6e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.518038:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b31d6e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.518064:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:0.0:1788581666.518067:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788581666.518073:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b31d6e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.518079:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b31d6e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.518137:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b31d67 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2270a expref: 30 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.518148:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff995d4203b700) 00010000:00010000:0.0:1788581666.518151:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581666.518154:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b31d67 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2270a expref: 30 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.518165:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71a00, rc 0) 00000100:00100000:0.0:1788581666.518251:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+29:18789:x1875463170592128:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 621us (1126us total) trans 12884901907 rc 301/301 00000100:00100000:0.0:1788581666.522276:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:1.0:1788581666.525297:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581666.525405:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170592256 00000100:00100000:3.0:1788581666.525419:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170592256 00000100:00100000:3.0:1788581666.525505:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:3.0:1788581666.525518:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+29:18789:x1875463170592256:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788581666.525570:0:22626:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788581666.525722:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+29:18789:x1875463170592256:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 206us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581666.525731:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:1.0:1788581666.529309:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581666.529542:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170592512 00000100:00100000:3.0:1788581666.529557:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170592512 00000100:00100000:3.0:1788581666.529635:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:3.0:1788581666.529647:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267202bf-c8d5-4953-b113-02f06afe1645+29:18789:x1875463170592512:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581666.529674:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581666.529700:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b31d7c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22711 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788581666.530311:0:22627:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:3.0:1788581666.530321:0:22627:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:3.0:1788581666.530346:0:22627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:3.0:1788581666.530538:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b31d83 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.530555:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b31d83 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.530567:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b31d83 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.530638:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981800/0x50f0cc74b7b31d7c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22711 expref: 32 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.530671:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b31d83 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22711 expref: 31 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.530680:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff995e6f925800) 00010000:00010000:3.0:1788581666.530683:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581666.530687:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f980a00, rc 0) 00000100:00100000:3.0:1788581666.530782:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267202bf-c8d5-4953-b113-02f06afe1645+31:18789:x1875463170592512:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1137us (1533us total) trans 12884901908 rc 0/0 00000100:00100000:3.0:1788581666.530791:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:2.0:1788581666.535804:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581666.536095:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170592768 00000100:00100000:3.0:1788581666.536110:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170592768 00000100:00100000:3.0:1788581666.536196:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:3.0:1788581666.536210:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+31:18789:x1875463170592768:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788581666.536972:0:22626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581666.537015:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980a00/0x50f0cc74b7b31d83 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22711 expref: 31 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537040:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff995e6f925800) 00010000:00010000:2.0:1788581666.537065:0:22626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581666.537100:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31d91 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537117:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31d91 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537151:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31d91 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537170:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02600/0x50f0cc74b7b31d98 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa0fa01dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537177:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02600/0x50f0cc74b7b31d98 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa0fa01dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537184:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02600/0x50f0cc74b7b31d98 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa0fa01dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537247:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31d91 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537605:0:22626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31d91 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537613:0:22626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31d91 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537619:0:22626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e46d03200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581666.537624:0:22626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31d91 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537632:0:22626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31d91 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537644:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff995d4203ae00) 00010000:00010000:2.0:1788581666.537647:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581666.537651:0:22626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31d91 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537667:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d03200/0x50f0cc74b7b31d91 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537681:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02600/0x50f0cc74b7b31d98 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa0fa01dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537686:0:22626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02600/0x50f0cc74b7b31d98 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa0fa01dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537692:0:22626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02600/0x50f0cc74b7b31d98 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa0fa01dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537697:0:22626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e46d02600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:2.0:1788581666.537700:0:22626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02600/0x50f0cc74b7b31d98 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa0fa01dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537706:0:22626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02600/0x50f0cc74b7b31d98 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa0fa01dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537714:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xa0fa01dc (ffff995d4203bf00) 00010000:00010000:2.0:1788581666.537716:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581666.537719:0:22626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02600/0x50f0cc74b7b31d98 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa0fa01dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.537725:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02600/0x50f0cc74b7b31d98 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa0fa01dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581666.537928:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+30:18789:x1875463170592768:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 1718us (2134us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581666.537941:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:1.0:1788581666.539923:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581666.540020:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170592896 00000100:00100000:0.0:1788581666.540032:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170592896 00000100:00100000:0.0:1788581666.540133:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:0.0:1788581666.540145:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+30:18789:x1875463170592896:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581666.540176:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581666.540200:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b31d9f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22718 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.540238:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b31da6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.540250:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b31da6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.540297:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b31da6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.540426:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b31d9f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22718 expref: 32 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.540446:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71000/0x50f0cc74b7b31da6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22718 expref: 31 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.540455:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff995d4203a700) 00010000:00010000:0.0:1788581666.540458:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788581666.540462:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa71000, rc 0) 00000100:00100000:0.0:1788581666.540540:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+31:18789:x1875463170592896:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 396us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581666.540548:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:1.0:1788581666.544393:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581666.544619:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170593152 00000100:00100000:0.0:1788581666.544633:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170593152 00000100:00100000:0.0:1788581666.544749:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:0.0:1788581666.544763:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:267202bf-c8d5-4953-b113-02f06afe1645+31:18789:x1875463170593152:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788581666.544900:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b31dad lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.544923:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b31dad lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.544938:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b31dad lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788581666.545190:0:25422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1788581666.545203:0:25422:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 652686947677ns, next at 653686944204ns, rc = 0 00000004:00010000:0.0:1788581666.545321:0:25422:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000363b9f9e reply state 00000000c6c92b87 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b31dad lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.545337:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b31dad lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.545347:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff995d4203a700) 00010000:00010000:0.0:1788581666.545350:0:25422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788581666.545354:0:25422:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788581666.545508:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:267202bf-c8d5-4953-b113-02f06afe1645+33:18789:x1875463170593152:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 745us (1269us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1788581666.545517:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:2.0:1788581666.547848:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581666.548614:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170593280 00000100:00100000:1.0:1788581666.548632:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170593280 00000100:00100000:1.0:1788581666.548722:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1788581666.548735:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+33:18789:x1875463170593280:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581666.548769:0:23963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581666.548799:0:23963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b31db4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2271f expref: -99 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.548881:0:23963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b31db4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2271f expref: 34 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.548899:0:23963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b31db4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2271f expref: 34 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.548921:0:23963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff995d4203a700) 00010000:00010000:1.0:1788581666.548925:0:23963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788581666.548930:0:23963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6aa00, rc 0) 00000100:00100000:1.0:1788581666.549004:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+34:18789:x1875463170593280:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 272us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581666.549011:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1788581666.552081:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581666.552746:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170593408 00000100:00100000:2.0:1788581666.552762:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170593408 00000100:00100000:2.0:1788581666.552903:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:2.0:1788581666.552919:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267202bf-c8d5-4953-b113-02f06afe1645+5:2395:x1875463170593408:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788581666.553721:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581666.559178:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267202bf-c8d5-4953-b113-02f06afe1645+6:2395:x1875463170593408:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 6254us (7111us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788581666.559193:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:1.0:1788581666.574492:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581666.574999:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170593664 00000100:00100000:0.0:1788581666.575014:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170593664 00000100:00100000:0.0:1788581666.575104:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:0.0:1788581666.575118:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:267202bf-c8d5-4953-b113-02f06afe1645+34:18789:x1875463170593664:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788581666.575464:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:267202bf-c8d5-4953-b113-02f06afe1645+35:18789:x1875463170593664:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 348us (1007us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1788581666.575713:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:1.0:1788581666.579417:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581666.579837:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170593920 00000100:00100000:0.0:1788581666.579850:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170593920 00000100:00100000:0.0:1788581666.579930:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:0.0:1788581666.579943:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+35:18789:x1875463170593920:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788581666.580176:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+35:18789:x1875463170593920:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 235us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581666.580185:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:1.0:1788581666.585280:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581666.585445:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170594048 00000100:00100000:0.0:1788581666.585459:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170594048 00000100:00100000:0.0:1788581666.585852:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:0.0:1788581666.585865:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:267202bf-c8d5-4953-b113-02f06afe1645+35:18789:x1875463170594048:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581666.585896:0:25422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581666.585926:0:25422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b31dbb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22726 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.586066:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31dc2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.586085:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31dc2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.586100:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31dc2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581666.586160:0:25422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788581666.586185:0:25422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31dc2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.586229:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b31dbb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22726 expref: 37 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.586665:0:25422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31dc2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22726 expref: 36 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.586677:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff995d4203a700) 00010000:00010000:0.0:1788581666.586680:0:25422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788581666.586684:0:25422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e7fa70a00, rc 0) 00000100:00100000:0.0:1788581666.586773:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:267202bf-c8d5-4953-b113-02f06afe1645+36:18789:x1875463170594048:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 909us (1533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581666.586781:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:2.0:1788581666.589724:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581666.589835:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170594176 00000100:00100000:1.0:1788581666.589850:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170594176 00000100:00100000:1.0:1788581666.590781:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:1.0:1788581666.590797:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:267202bf-c8d5-4953-b113-02f06afe1645+6:2395:x1875463170594176:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581666.590823:0:24131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581666.590854:0:24131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d8b13ef/0x50f0cc74b7b31dc9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2272d expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788581666.590888:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b9722, blocks: 0x0 00010000:00010000:1.0:1788581666.590913:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=652s v=(0 0) 00010000:00010000:1.0:1788581666.590918:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581666.590929:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d8b13ef/0x50f0cc74b7b31dc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2272d expref: 7 pid: 24131 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.590950:0:24131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007d8b13ef/0x50f0cc74b7b31dc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2272d expref: 7 pid: 24131 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.590967:0:24131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b200, rc 0) 00000100:00100000:1.0:1788581666.591062:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:267202bf-c8d5-4953-b113-02f06afe1645+7:2395:x1875463170594176:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 261us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581666.591070:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:1.0:1788581666.594688:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581666.594797:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170594432 00000100:00100000:2.0:1788581666.594809:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170594432 00000100:00100000:2.0:1788581666.594887:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:2.0:1788581666.594900:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+36:18789:x1875463170594432:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788581666.595045:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267202bf-c8d5-4953-b113-02f06afe1645+36:18789:x1875463170594432:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 147us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581666.595062:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:2.0:1788581666.597569:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581666.597961:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170594560 00000100:00100000:1.0:1788581666.597974:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170594560 00000100:00100000:1.0:1788581666.598044:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:1.0:1788581666.598064:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+36:18789:x1875463170594560:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788581666.606970:0:22607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:2.0:1788581666.606990:0:22607:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788581666.607115:0:22607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:0.0:1788581666.607120:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581666.607143:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184320640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788581666.607215:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581666.607304:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b31c02 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607316:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b31c02 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607324:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b31c02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607330:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581666.607335:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b31c02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607343:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b31c02 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607365:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff995d4203ab00) 00010000:00010000:3.0:1788581666.607368:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581666.607372:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b31c02 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607379:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70e00/0x50f0cc74b7b31c02 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607400:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b31c09 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607406:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b31c09 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607412:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b31c09 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607417:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581666.607420:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b31c09 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607426:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b31c09 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607434:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff995d4203ae00) 00010000:00010000:3.0:1788581666.607436:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581666.607439:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b31c09 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607444:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71c00/0x50f0cc74b7b31c09 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607467:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02c00/0x50f0cc74b7b31cb1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607473:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02c00/0x50f0cc74b7b31cb1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607479:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02c00/0x50f0cc74b7b31cb1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607495:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e46d02c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581666.607499:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02c00/0x50f0cc74b7b31cb1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607514:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02c00/0x50f0cc74b7b31cb1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607523:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff995d4203bb00) 00010000:00010000:3.0:1788581666.607525:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581666.607528:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02c00/0x50f0cc74b7b31cb1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607533:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02c00/0x50f0cc74b7b31cb1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607549:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d36 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607555:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d36 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607560:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d36 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607571:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f981000 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581666.607574:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d36 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607580:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d36 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607588:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:3.0:1788581666.607590:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581666.607593:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d36 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607599:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981000/0x50f0cc74b7b31d36 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607610:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b31dad lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607619:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b31dad lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607625:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b31dad lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607631:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70c00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:3.0:1788581666.607634:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b31dad lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607641:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b31dad lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581666.607656:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184320640 00010000:00010000:3.0:1788581666.607660:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff995d4203a700) 00010000:00010000:3.0:1788581666.607664:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788581666.607665:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184320640 00010000:00010000:3.0:1788581666.607668:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b31dad lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.607676:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70c00/0x50f0cc74b7b31dad lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581666.607730:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788581666.607741:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184320640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788581666.607868:0:24134:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788581666.607871:0:24134:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788581666.607874:0:24134:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788581666.607882:0:24134:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788581666 -> 1788581666 00002000:00010000:2.0:1788581666.607884:0:24134:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1788581666.607931:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b31c56 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581666.607937:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3619:x1875463184320640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 195us (719us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788581666.607946:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788581666.607958:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b31c56 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.607965:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b31c56 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.607971:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70200 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:1.0:1788581666.607975:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b31c56 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.607981:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b31c56 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.607991:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff995d4203ae00) 00010000:00010000:1.0:1788581666.607993:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788581666.607996:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b31c56 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.608002:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70200/0x50f0cc74b7b31c56 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788581666.608101:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581666.608200:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+15:18789:x1875463170594560:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 Request processed in 10146us (10643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581666.608209:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00000004:00080000:1.0:1788581666.608921:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff995e4327b100/2, rc 0, transno 12884901892 00000100:00100000:1.0:1788581666.608929:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184320640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788581666.612662:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581666.612744:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170594688 00000100:00100000:2.0:1788581666.612753:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170594688 00000100:00100000:2.0:1788581666.612807:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:2.0:1788581666.612816:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267202bf-c8d5-4953-b113-02f06afe1645+7:2396:x1875463170594688:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788581666.613044:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267202bf-c8d5-4953-b113-02f06afe1645+7:2396:x1875463170594688:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 Request processed in 228us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581666.613052:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:2.0:1788581666.623801:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581666.624309:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170594944 00000100:00100000:0.0:1788581666.624320:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170594944 00000100:00100000:0.0:1788581666.624387:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:0.0:1788581666.624397:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:267202bf-c8d5-4953-b113-02f06afe1645+15:18789:x1875463170594944:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788581666.624461:0:25422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581666.624489:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31dc2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22726 expref: 15 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.624508:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff995d4203a700) 00010000:00010000:0.0:1788581666.624513:0:25422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581666.624544:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b31dd0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.624572:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b31dd0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.624583:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b31dd0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581666.624705:0:25422:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6587bcf reply state 00000000364ef79f transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b31dd0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.624718:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71a00/0x50f0cc74b7b31dd0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.624724:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff995d4203a700) 00010000:00010000:0.0:1788581666.624727:0:25422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788581666.624730:0:25422:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788581666.624886:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:267202bf-c8d5-4953-b113-02f06afe1645+16:18789:x1875463170594944:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 490us (1094us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1788581666.624893:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:1.0:1788581666.633769:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581666.633873:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170595072 00000100:00100000:3.0:1788581666.633883:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170595072 00000100:00100000:3.0:1788581666.633940:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:3.0:1788581666.633950:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:267202bf-c8d5-4953-b113-02f06afe1645+7:18789:x1875463170595072:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581666.633968:0:24665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581666.633984:0:24665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31dd7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df22734 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.634013:0:24665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007d8b13ef/0x50f0cc74b7b31dc9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2272d expref: 8 pid: 24131 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.634022:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581666.634026:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581666.634031:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31dd7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22734 expref: 8 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.634076:0:24665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007d8b13ef/0x50f0cc74b7b31dc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2272d expref: 8 pid: 24131 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.634101:0:24665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007d8b13ef/0x50f0cc74b7b31dc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2272d expref: 8 pid: 24131 timeout: 752 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581666.634113:0:24665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43969880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24665:1875463184320768:192.168.203.3@tcp:104: 00000100:00100000:3.0:1788581666.634187:0:24665:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46d92e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581666.643949:0:24665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43969880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24665:1875463184320768:192.168.203.3@tcp:104: 00010000:00010000:3.0:1788581666.643990:0:24665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31dd7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22734 expref: 8 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.644013:0:24665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e6f981000, rc 0) 00000100:00100000:3.0:1788581666.644087:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:267202bf-c8d5-4953-b113-02f06afe1645+8:18789:x1875463170595072:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 10136us (10326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581666.644368:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:2.0:1788581666.649135:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581666.649241:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170595200 00000100:00100000:3.0:1788581666.649287:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170595200 00010000:00010000:3.0:1788581666.649326:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007d8b13ef/0x50f0cc74b7b31dc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2272d expref: 8 pid: 24131 timeout: 752 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581666.649369:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:3.0:1788581666.649381:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45db5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:267202bf-c8d5-4953-b113-02f06afe1645+8:2395:x1875463170595200:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581666.649395:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581666.649418:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007d8b13ef/0x50f0cc74b7b31dc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2272d expref: 8 pid: 24131 timeout: 752 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.649452:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007d8b13ef/0x50f0cc74b7b31dc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2272d expref: 8 pid: 24131 timeout: 752 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.649476:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d8b13ef/0x50f0cc74b7b31dc9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2272d expref: 8 pid: 24131 timeout: 752 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.649491:0:22612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581666.649496:0:22612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581666.649503:0:22612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31dd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22734 expref: 7 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.649514:0:22612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31dd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22734 expref: 7 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.649559:0:22612:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31dd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22734 expref: 7 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581666.649576:0:22612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43969880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22612:1875463184320896:192.168.203.3@tcp:105: 00000100:00100000:3.0:1788581666.649655:0:22612:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46d92e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581666.663347:0:22612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43969880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22612:1875463184320896:192.168.203.3@tcp:105: 00010000:00010000:3.0:1788581666.663392:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581666.663467:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45db5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:267202bf-c8d5-4953-b113-02f06afe1645+7:2395:x1875463170595200:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 14087us (14340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581666.663478:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:2.0:1788581666.663985:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581666.664137:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170595328 00000100:00100000:3.0:1788581666.664428:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170595328 00000100:00100000:2.0:1788581666.664572:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:2.0:1788581666.664583:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d41c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:267202bf-c8d5-4953-b113-02f06afe1645+7:2396:x1875463170595328:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788581666.664723:0:24134:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788581666.664727:0:24134:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788581666 00002000:00010000:2.0:1788581666.664730:0:24134:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788581665 00002000:00010000:2.0:1788581666.664732:0:24134:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788581666 -> 1788581666 00002000:00010000:2.0:1788581666.664734:0:24134:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788581666.664788:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d41c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:267202bf-c8d5-4953-b113-02f06afe1645+8:2396:x1875463170595328:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 206us (803us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788581666.664796:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:2.0:1788581666.667398:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581666.667490:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170595456 00000100:00100000:1.0:1788581666.667500:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170595456 00000100:00100000:1.0:1788581666.667551:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:1.0:1788581666.667561:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d41c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267202bf-c8d5-4953-b113-02f06afe1645+8:2395:x1875463170595456:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788581666.667600:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31dde lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.667620:0:24133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31dd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0x3786f996df22734 expref: 8 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.667628:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581666.667632:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788581666.667636:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31dde lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.667668:0:24133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31dd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22734 expref: 8 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.667682:0:24133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31dd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22734 expref: 8 pid: 24665 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581666.667696:0:24133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4386df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24133:1875463184321024:192.168.203.3@tcp:104: 00000100:00100000:1.0:1788581666.667776:0:24133:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e6f9963c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581666.670475:0:24133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4386df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24133:1875463184321024:192.168.203.3@tcp:104: 00010000:00010000:1.0:1788581666.670503:0:24133:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31dde lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581666.675038:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581666.675392:0:24158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170595584 00000100:00100000:0.0:1788581666.675404:0:24158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170595584 00010000:00010000:0.0:1788581666.675448:0:24158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31dd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22734 expref: 9 pid: 24665 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581666.675493:0:24158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:0.0:1788581666.675504:0:24158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d41c28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:267202bf-c8d5-4953-b113-02f06afe1645+9:2395:x1875463170595584:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581666.675542:0:24158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581666.675565:0:24158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31dd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22734 expref: 9 pid: 24665 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.675593:0:24158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31dd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22734 expref: 9 pid: 24665 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.675617:0:24158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5c4856f/0x50f0cc74b7b31dd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0x3786f996df22734 expref: 9 pid: 24665 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.675634:0:24158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581666.675639:0:24158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581666.675645:0:24158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31dde lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.675655:0:24158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31dde lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.675689:0:24158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581666.675752:0:24158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d41c28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:267202bf-c8d5-4953-b113-02f06afe1645+8:2395:x1875463170595584:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 250us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581666.675759:0:24158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00010000:00010000:1.0:1788581666.676049:0:24133:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31dde lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.676070:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31dde lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.676094:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31dde lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.676103:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31dde lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.676111:0:24133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31dde lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.676119:0:24133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e49e6a600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581666.676123:0:24133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31dde lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.676132:0:24133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31dde lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.676144:0:24133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31dde lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.676164:0:24133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e40e3fb2/0x50f0cc74b7b31dde lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581666.676224:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d41c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267202bf-c8d5-4953-b113-02f06afe1645+7:2395:x1875463170595456:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 Request processed in 8664us (8834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581666.676233:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:2.0:1788581666.691686:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581666.691753:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170595840 00000100:00100000:0.0:1788581666.691764:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170595840 00000100:00100000:0.0:1788581666.691838:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:0.0:1788581666.691850:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d41c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+16:18789:x1875463170595840:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788581666.691932:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31de5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.691965:0:22628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02a00/0x50f0cc74b7b31d2f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df226f5 expref: 16 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.691975:0:22628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31de5 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.692006:0:22628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02a00/0x50f0cc74b7b31d2f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226f5 expref: 16 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.692019:0:22628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02a00/0x50f0cc74b7b31d2f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226f5 expref: 16 pid: 23963 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581666.692034:0:22628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22628:1875463184321152:192.168.203.3@tcp:104: 00000100:00100000:0.0:1788581666.692117:0:22628:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46a45180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581666.699549:0:22628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22628:1875463184321152:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581666.699579:0:22628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31de5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581666.700071:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581666.700160:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170595968 00000100:00100000:1.0:1788581666.700167:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170595968 00010000:00010000:1.0:1788581666.700203:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02a00/0x50f0cc74b7b31d2f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226f5 expref: 17 pid: 23963 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581666.700245:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:1.0:1788581666.700275:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d41c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:267202bf-c8d5-4953-b113-02f06afe1645+17:2395:x1875463170595968:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581666.700289:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581666.700296:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02a00/0x50f0cc74b7b31d2f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226f5 expref: 17 pid: 23963 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.700310:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02a00/0x50f0cc74b7b31d2f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226f5 expref: 17 pid: 23963 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.700332:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e46d02a00/0x50f0cc74b7b31d2f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df226f5 expref: 17 pid: 23963 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.700349:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:1.0:1788581666.700356:0:22613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b31d4b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22703 expref: 16 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.700384:0:22613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31de5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.700392:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31de5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.700398:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31de5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.700425:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581666.700483:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d41c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:267202bf-c8d5-4953-b113-02f06afe1645+16:2395:x1875463170595968:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 229us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581666.700494:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00010000:00010000:0.0:1788581666.701138:0:22628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31de5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.701149:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31de5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.701392:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31dec lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.701406:0:22628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b31db4 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2271f expref: 16 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.701422:0:22628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31dec lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.701455:0:22628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b31db4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2271f expref: 16 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.701469:0:22628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b31db4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2271f expref: 16 pid: 23963 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581666.701483:0:22628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22628:1875463184321280:192.168.203.3@tcp:104: 00000100:00100000:0.0:1788581666.701554:0:22628:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46a45cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581666.704493:0:22628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22628:1875463184321280:192.168.203.3@tcp:104: 00010000:00010000:0.0:1788581666.704521:0:22628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31dec lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581666.705178:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581666.705440:0:24158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170596096 00000100:00100000:0.0:1788581666.705448:0:24158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170596096 00010000:00010000:0.0:1788581666.705495:0:24158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b31db4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2271f expref: 17 pid: 23963 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581666.705534:0:24158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:0.0:1788581666.705544:0:24158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d41c28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:267202bf-c8d5-4953-b113-02f06afe1645+17:2396:x1875463170596096:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581666.705558:0:24158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581666.705565:0:24158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b31db4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2271f expref: 17 pid: 23963 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.705597:0:24158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b31db4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2271f expref: 17 pid: 23963 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.705618:0:24158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6aa00/0x50f0cc74b7b31db4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x3786f996df2271f expref: 17 pid: 23963 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.705635:0:24158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff995d4203a700) 00010000:00010000:0.0:1788581666.705640:0:24158:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31dec lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.705650:0:24158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31dec lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.705657:0:24158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31dec lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.705994:0:24158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581666.706066:0:24158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d41c28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:267202bf-c8d5-4953-b113-02f06afe1645+16:2396:x1875463170596096:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 522us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581666.706075:0:24158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00010000:00010000:1.0:1788581666.706931:0:22628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31dec lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.706942:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31dec lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788581666.707063:0:22628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:1.0:1788581666.707398:0:22628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1788581666.707437:0:22628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:1.0:1788581666.707634:0:22628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4386df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22628:1875463184321408:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788581666.707691:0:22628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581666.707779:0:22628:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e7a48ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581666.707898:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184321408 00000100:00100000:2.0:1788581666.707906:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184321408 00000100:00100000:2.0:1788581666.707983:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788581666.707993:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22628:x1875463184321408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788581666.708097:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22628:x1875463184321408:12345-0@lo:1000:mdt00_002.0 Request processed in 105us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581666.708104:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788581666.708173:0:22628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4386df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22628:1875463184321408:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788581666.708361:0:22628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1788581666.708410:0:22628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22628:1875463184321536:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788581666.708439:0:22628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581666.708922:0:22628:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46a45180 going to sleep for 11 seconds 00000100:00100000:1.0:1788581666.708997:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184321536 00000100:00100000:1.0:1788581666.709003:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184321536 00000100:00100000:1.0:1788581666.709032:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788581666.709038:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e43279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22628:x1875463184321536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788581666.709213:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e43279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22628:x1875463184321536:12345-0@lo:1000:mdt00_002.0 Request processed in 173us (772us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1788581666.709221:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788581666.709387:0:22628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e43279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22628:1875463184321536:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788581666.709427:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31dec lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.709445:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31dec lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.709453:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31dec lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.709460:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71600 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581666.709464:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31dec lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.709487:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31dec lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.709503:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff995d4203a700) 00010000:00010000:0.0:1788581666.709506:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788581666.709511:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31dec lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.709517:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71600/0x50f0cc74b7b31dec lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.709547:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b31d44 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.709554:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b31d44 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.709560:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b31d44 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.709565:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581666.709575:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b31d44 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.709581:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b31d44 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.709590:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:0.0:1788581666.709592:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788581666.709598:0:22628:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b31d4b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22703 expref: 19 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.709608:0:22628:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b31d4b lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22703 expref: 19 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.709617:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b31d4b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22703 expref: 19 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.709668:0:22628:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f981600/0x50f0cc74b7b31d4b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df22703 expref: 19 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581666.709679:0:22628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22628:1875463184321664:192.168.203.3@tcp:105: 00000100:00100000:0.0:1788581666.709745:0:22628:0:(client.c:2715:ptlrpc_set_wait()) set ffff995e46a45180 going to sleep for 11 seconds 00000100:00100000:2.0:1788581666.713535:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581666.713615:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170596224 00000100:00100000:3.0:1788581666.713624:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170596224 00000100:00100000:3.0:1788581666.713682:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:3.0:1788581666.713692:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e50d08450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:267202bf-c8d5-4953-b113-02f06afe1645+20:18788:x1875463170596224:12345-192.168.203.3@tcp:49:dd.0 00000100:00100000:3.0:1788581666.713825:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e50d08450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:267202bf-c8d5-4953-b113-02f06afe1645+20:18788:x1875463170596224:12345-192.168.203.3@tcp:49:dd.0 Request processed in 134us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581666.713833:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:0.0:1788581666.717702:0:22628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22628:1875463184321664:192.168.203.3@tcp:105: 00010000:00010000:0.0:1788581666.717734:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b31d44 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.717745:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980e00/0x50f0cc74b7b31d44 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.718009:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31df3 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.718024:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31df3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.718035:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31df3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.718046:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31df3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.718063:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31df3 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.718070:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31df3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.718076:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71e00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581666.718080:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31df3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.718087:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31df3 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.718097:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:0.0:1788581666.718100:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581666.718103:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31df3 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.718108:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa71e00/0x50f0cc74b7b31df3 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.718126:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31de5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.718626:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31de5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.718633:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31de5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.718639:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa70a00 already unused, calling callback (ffffffffc1a714f0) 00010000:00010000:0.0:1788581666.718642:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31de5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.718649:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31de5 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.718659:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:0.0:1788581666.718662:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788581666.718665:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31de5 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.718672:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e7fa70a00/0x50f0cc74b7b31de5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581666.718976:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d41c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+19:18789:x1875463170595840:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 27124us (27295us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1788581666.718986:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000020:00080000:0.0:1788581666.718992:0:22628:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788581666.719312:0:22661:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788581666.719317:0:22661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788581666.719334:0:22661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788581666.719341:0:22661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788581666.722567:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581666.722795:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170596352 00000100:00100000:1.0:1788581666.722805:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170596352 00000100:00100000:1.0:1788581666.722864:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:1.0:1788581666.722876:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d41c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+19:18788:x1875463170596352:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:1.0:1788581666.722897:0:23963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581666.722927:0:23963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b31dfa lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3786f996df2273b expref: -99 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.722965:0:23963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31e01 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.722979:0:23963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31e01 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.722991:0:23963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31e01 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.723139:0:23963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b200/0x50f0cc74b7b31dfa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2273b expref: 21 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.723161:0:23963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff995e49e6b600/0x50f0cc74b7b31e01 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x3786f996df2273b expref: 20 pid: 23963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581666.723170:0:23963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff995d4203ba00) 00010000:00010000:1.0:1788581666.723173:0:23963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788581666.723183:0:23963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff995e49e6b600, rc 0) 00000100:00100000:1.0:1788581666.723297:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d41c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267202bf-c8d5-4953-b113-02f06afe1645+20:18788:x1875463170596352:12345-192.168.203.3@tcp:101:dd.0 Request processed in 423us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581666.723303:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:1.0:1788581666.728845:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1788581666.729033:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170596608 00000100:00100000:3.0:1788581666.729043:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170596608 00000100:00100000:3.0:1788581666.729111:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:3.0:1788581666.729122:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:267202bf-c8d5-4953-b113-02f06afe1645+20:18789:x1875463170596608:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788581666.729434:0:22629:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788581666.729466:0:22629:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1788581666.729506:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31e08 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.729523:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31e08 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.729535:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31e08 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.729544:0:22629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31e08 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.729550:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31e08 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.729572:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31e08 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581666.729595:0:22629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788581666.729677:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:267202bf-c8d5-4953-b113-02f06afe1645+22:18789:x1875463170596608:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 556us (840us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1788581666.729685:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000020:00080000:3.0:1788581666.729690:0:22629:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788581666.730307:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581666.730314:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31e08 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.730322:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e6f980600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:2.0:1788581666.730325:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31e08 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.730333:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31e08 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.730346:0:22615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff995d4203a700) 00010000:00010000:2.0:1788581666.730349:0:22615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788581666.730362:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31e08 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.730368:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff995e6f980600/0x50f0cc74b7b31e08 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581666.730381:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581666.730382:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581666.730384:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581666.961252:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1788581666.961317:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1788581666.961434:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170596736 00000100:00100000:0.0:1788581666.961443:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170596736 00000100:00100000:0.0:1788581666.961535:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170596864 00000100:00100000:0.0:1788581666.961539:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170596864 00000100:00100000:0.0:1788581666.961562:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:0.0:1788581666.961571:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d41c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:267202bf-c8d5-4953-b113-02f06afe1645+8:2396:x1875463170596736:12345-192.168.203.3@tcp:4:dd.0 00002000:00010000:0.0:1788581666.961630:0:24137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9b9722, atime: 0x6a9b9721, ctime: 0x6a9b9722, blocks: 0x0 00010000:00010000:0.0:1788581666.961640:0:24137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbf08c63/0x50f0cc74b7b31e0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.961857:0:24137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=653s v=(0 0) 00010000:00010000:0.0:1788581666.961863:0:24137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581666.961870:0:24137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbf08c63/0x50f0cc74b7b31e0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581666.961888:0:24137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbf08c63/0x50f0cc74b7b31e0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581667.074101:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788581667.076957:0:24948:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:2.0:1788581667.076972:0:24948:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:1.0:1788581667.077183:0:24137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1788581667.077188:0:24137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1788581667.077207:0:24137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbf08c63/0x50f0cc74b7b31e0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581667.077220:0:24137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbf08c63/0x50f0cc74b7b31e0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581667.077228:0:24137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbf08c63/0x50f0cc74b7b31e0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581667.077235:0:24137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71e00 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:1.0:1788581667.077241:0:24137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbf08c63/0x50f0cc74b7b31e0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581667.077250:0:24137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbf08c63/0x50f0cc74b7b31e0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581667.078162:0:24137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbf08c63/0x50f0cc74b7b31e0f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581667.078170:0:24137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbf08c63/0x50f0cc74b7b31e0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581667.080788:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d41c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:267202bf-c8d5-4953-b113-02f06afe1645+6:2396:x1875463170596736:12345-192.168.203.3@tcp:4:dd.0 Request processed in 119204us (119533us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788581667.080802:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:0.0:1788581667.080913:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:0.0:1788581667.080926:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d41c28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:267202bf-c8d5-4953-b113-02f06afe1645+5:2395:x1875463170596864:12345-192.168.203.3@tcp:4:dd.0 00002000:00010000:0.0:1788581667.080978:0:24137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 4194304, mtime: 0x6a9b9722, atime: 0x6a9b9721, ctime: 0x6a9b9722, blocks: 0x2000 00010000:00010000:0.0:1788581667.080987:0:24137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b31e16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581667.081002:0:24137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=653s v=(0 0) 00010000:00010000:0.0:1788581667.081022:0:24137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581667.081029:0:24137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b31e16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581667.081042:0:24137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b31e16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581667.139629:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4396ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184321792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788581667.139740:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581667.140499:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184321792 00000100:00100000:2.0:1788581667.140515:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184321792 00000100:00100000:2.0:1788581667.140597:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788581667.140611:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184321792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788581667.140644:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788581667.140728:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875463184321792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581667.140736:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788581667.140879:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4396ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875463184321792:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788581667.143922:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788581667.177103:0:24948:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:0.0:1788581667.177331:0:24137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1788581667.177337:0:24137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1788581667.177359:0:24137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b31e16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581667.177375:0:24137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b31e16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581667.177385:0:24137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b31e16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581667.177393:0:24137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff995e7fa71600 already unused, calling callback (ffffffffc0e79230) 00010000:00010000:0.0:1788581667.177399:0:24137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b31e16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581667.177408:0:24137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b31e16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581667.177436:0:24137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b31e16 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581667.177579:0:24137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f18c846/0x50f0cc74b7b31e16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581667.177788:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d41c28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:267202bf-c8d5-4953-b113-02f06afe1645+5:2395:x1875463170596864:12345-192.168.203.3@tcp:4:dd.0 Request processed in 96859us (216463us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788581667.177801:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:1.0:1788581667.649744:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581667.649772:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4386dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184321920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581667.649860:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581667.649917:0:23367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184321920 00000100:00100000:1.0:1788581667.649926:0:23367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184321920 00000100:00100000:1.0:1788581667.649993:0:23367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788581667.650003:0:23367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184321920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788581667.650057:0:23367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788581667.650105:0:23367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875463184321920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581667.650113:0:23367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788581667.650159:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4386dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875463184321920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788581667.650412:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581667.650423:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d41c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184322048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581667.650452:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581667.650677:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184322048 00000100:00100000:2.0:1788581667.650682:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184322048 00000100:00100000:2.0:1788581667.650716:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788581667.650724:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184322048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788581667.650748:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788581667.650788:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184322048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581667.650817:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788581667.650942:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d41c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184322048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788581668.082318:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581668.082498:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581668.082535:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581668.082563:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581668.082616:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170597248 00000100:00100000:1.0:1788581668.082628:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170597248 00000100:00080000:1.0:1788581668.082674:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788581668.082734:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170597760 00000100:00100000:1.0:1788581668.082739:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170597760 00000100:00100000:1.0:1788581668.082772:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:1.0:1788581668.082783:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+5:2396:x1875463170597248:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581668.082878:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267202bf-c8d5-4953-b113-02f06afe1645+5:2396:x1875463170597248:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 96us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581668.082885:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:1.0:1788581668.082904:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:1.0:1788581668.082910:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f130e6e6-d193-4588-a48c-a08395bb01b0+5:2396:x1875463170597760:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581668.082935:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f130e6e6-d193-4588-a48c-a08395bb01b0+5:2396:x1875463170597760:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581668.082942:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00080000:1.0:1788581668.082956:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788581668.082986:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581668.083013:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170597504 00000100:00100000:1.0:1788581668.083024:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170597504 00000100:00100000:1.0:1788581668.083070:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170598016 00000100:00100000:1.0:1788581668.083073:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170598016 00000100:00100000:1.0:1788581668.083098:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:1.0:1788581668.083105:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e45c9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:267202bf-c8d5-4953-b113-02f06afe1645+5:2396:x1875463170597504:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581668.083437:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e45c9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:267202bf-c8d5-4953-b113-02f06afe1645+5:2396:x1875463170597504:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 330us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581668.083446:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:1.0:1788581668.083614:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:1.0:1788581668.083628:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f130e6e6-d193-4588-a48c-a08395bb01b0+5:2396:x1875463170598016:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581668.083668:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f130e6e6-d193-4588-a48c-a08395bb01b0+5:2396:x1875463170598016:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 43us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581668.083675:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00080000:1.0:1788581668.083695:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581668.083738:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581668.083764:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170597120 00000100:00100000:1.0:1788581668.083770:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170597120 00000100:00100000:1.0:1788581668.083803:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:1.0:1788581668.083810:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:267202bf-c8d5-4953-b113-02f06afe1645+22:2396:x1875463170597120:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581668.083843:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:267202bf-c8d5-4953-b113-02f06afe1645+22:2396:x1875463170597120:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581668.083850:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00080000:1.0:1788581668.083867:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581668.083930:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581668.083949:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170597376 00000100:00100000:1.0:1788581668.083953:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170597376 00000100:00100000:1.0:1788581668.083979:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:1.0:1788581668.083986:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267202bf-c8d5-4953-b113-02f06afe1645+5:2396:x1875463170597376:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581668.084012:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267202bf-c8d5-4953-b113-02f06afe1645+5:2396:x1875463170597376:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581668.084018:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00080000:1.0:1788581668.084031:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581668.084068:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581668.084084:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170597632 00000100:00100000:1.0:1788581668.084088:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170597632 00000100:00080000:1.0:1788581668.084108:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581668.084131:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1788581668.084138:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f130e6e6-d193-4588-a48c-a08395bb01b0+6:2396:x1875463170597632:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581668.084168:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f130e6e6-d193-4588-a48c-a08395bb01b0+6:2396:x1875463170597632:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 31us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581668.084173:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1788581668.084219:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1788581668.084236:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170597888 00000100:00100000:1.0:1788581668.084240:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170597888 00000100:00100000:1.0:1788581668.084303:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:1.0:1788581668.084311:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4386ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f130e6e6-d193-4588-a48c-a08395bb01b0+5:2396:x1875463170597888:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1788581668.084337:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4386ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f130e6e6-d193-4588-a48c-a08395bb01b0+5:2396:x1875463170597888:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581668.084343:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00080000:1.0:1788581668.084356:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581668.085566:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463170596992 00000100:00100000:3.0:1788581668.085581:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463170596992 00000100:00100000:3.0:1788581668.085786:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 166 00000100:00100000:3.0:1788581668.085797:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+13:2396:x1875463170596992:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1788581668.085878:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40679648-646c-420e-a9fb-5d43fe1ee374+13:2396:x1875463170596992:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 83us (3574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581668.085885:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 166 00010000:00010000:3.0:1788581668.098730:0:25028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581668.673524:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581668.673552:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d4386df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184322176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581668.673645:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581668.675509:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581668.675535:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184322304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788581668.675621:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581668.676308:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184322176 00000100:00100000:2.0:1788581668.676323:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184322176 00000100:00100000:2.0:1788581668.676528:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184322304 00000100:00100000:2.0:1788581668.676533:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184322304 00000100:00100000:2.0:1788581668.676557:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788581668.676567:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7f614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184322176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581668.676599:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788581668.676732:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7f614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875463184322176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (3086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581668.676740:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788581668.676760:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788581668.676766:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e4327a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184322304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788581668.676777:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923501056 avail 3684274176 00000100:00100000:2.0:1788581668.676814:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e4327a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184322304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581668.676820:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788581668.676844:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581668.676849:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581668.676894:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184322304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788581668.676938:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d4386df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875463184322176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581668.678826:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d43969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184322432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581668.678915:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581668.678960:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d41d7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184322944:0@lo:400:kworker.0 00000100:00100000:3.0:1788581668.678989:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581668.679011:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d41d7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184323456:0@lo:400:kworker.0 00000100:00100000:3.0:1788581668.679033:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581668.679075:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788581668.679081:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184322560:0@lo:400:kworker.0 00000100:00100000:3.0:1788581668.679124:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581668.679160:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d41d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184323072:0@lo:400:kworker.0 00000100:00100000:3.0:1788581668.679187:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581668.679206:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d41d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184323584:0@lo:400:kworker.0 00000100:00100000:3.0:1788581668.679229:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581668.679292:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184322944 00000100:00100000:3.0:1788581668.679302:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184322944 00000100:00100000:3.0:1788581668.679357:0:25422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184323456 00000100:00100000:3.0:1788581668.679360:0:25422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184323456 00000100:00100000:0.0:1788581668.679658:0:23963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184323584 00000040:00080000:2.0:1788581668.679878:0:23380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788581668.679973:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184322432 00000100:00100000:2.0:1788581668.679979:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184322432 00000100:00100000:2.0:1788581668.680024:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788581668.680035:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184322432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581668.680083:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923501056 avail 3684274176 00000100:00100000:2.0:1788581668.680154:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875463184322432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581668.680162:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788581668.680185:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581668.680207:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995e4327bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184322688:0@lo:400:kworker.0 00000100:00100000:2.0:1788581668.680243:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581668.680298:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d41d7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184323200:0@lo:400:kworker.0 00000100:00100000:2.0:1788581668.680326:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581668.680347:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d41d7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184323712:0@lo:400:kworker.0 00000100:00100000:3.0:1788581668.680506:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788581668.680514:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184322944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581668.680555:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875463184322944:12345-0@lo:400:kworker.0 Request processed in 42us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581668.680562:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788581668.680576:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788581668.680583:0:25422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d43969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184323456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581668.680610:0:25422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d43969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875463184323456:12345-0@lo:400:kworker.0 Request processed in 28us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581668.680617:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788581668.680752:0:23963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184323584 00000100:00100000:0.0:1788581668.680791:0:23963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788581668.680798:0:23963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184323584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581668.680839:0:23963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875463184323584:12345-0@lo:400:kworker.0 Request processed in 42us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581668.680846:0:23963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788581668.680868:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184323072 00000100:00100000:0.0:1788581668.680871:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184323072 00000100:00100000:0.0:1788581668.680897:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184322688 00000100:00100000:0.0:1788581668.680901:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184322688 00000100:00100000:0.0:1788581668.680915:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788581668.680921:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d4396b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184323072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581668.680956:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d4396b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875463184323072:12345-0@lo:400:kworker.0 Request processed in 36us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581668.680962:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788581668.680983:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788581668.680989:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d41c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184322688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581668.681018:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d41c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184322688:12345-0@lo:400:kworker.0 Request processed in 29us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581668.681024:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788581668.681056:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184322560 00000100:00100000:0.0:1788581668.681061:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184322560 00000100:00100000:0.0:1788581668.681088:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788581668.681095:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995e7fafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:3620:x1875463184322560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581668.681126:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995e7fafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a361c037-f8ee-420d-b76d-dbdb9328e15d+24:3620:x1875463184322560:12345-0@lo:400:kworker.0 Request processed in 32us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581668.681132:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788581668.681211:0:3620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:3.0:1788581668.681218:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff995e4327b100, transno 12884901892 00000004:00080000:3.0:1788581668.681305:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:3.0:1788581668.681344:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d43969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875463184322432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581668.681366:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d41d7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875463184322944:0@lo:400:kworker.0 00000100:00100000:3.0:1788581668.681394:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d41d7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875463184323456:0@lo:400:kworker.0 00000100:00100000:3.0:1788581668.681426:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a361c037-f8ee-420d-b76d-dbdb9328e15d:3620:1875463184322560:0@lo:400:kworker.0 00000100:00100000:3.0:1788581668.681437:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d41d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875463184323072:0@lo:400:kworker.0 00010000:00080000:3.0:1788581668.681453:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d41d7f100 x1875463184323584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581668.681465:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d41d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875463184323584:0@lo:400:kworker.0 00000100:00080000:3.0:1788581668.681503:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581668.681507:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581668.681571:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581668.681615:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995e4327bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184322688:0@lo:400:kworker.0 00000100:00100000:2.0:1788581668.681626:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788581668.681634:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d41d7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184322816:0@lo:400:kworker.0 00000100:00100000:2.0:1788581668.681719:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581668.681743:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d41d7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184323328:0@lo:400:kworker.0 00000100:00100000:2.0:1788581668.681768:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581668.681786:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff995d41d7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184323840:0@lo:400:kworker.0 00000100:00100000:2.0:1788581668.681805:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581668.681839:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184323200 00000100:00100000:2.0:1788581668.681844:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184323200 00000100:00100000:2.0:1788581668.681879:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184322816 00000100:00100000:2.0:1788581668.681882:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184322816 00000100:00100000:2.0:1788581668.681901:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581668.681908:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d41c29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184323200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581668.681959:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d41c29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875463184323200:12345-0@lo:400:kworker.0 Request processed in 51us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581668.681965:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581668.681978:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581668.681982:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d41c29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184322816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581668.682004:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d41c29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875463184322816:12345-0@lo:400:kworker.0 Request processed in 22us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581668.682009:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581668.682036:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184323712 00000100:00100000:2.0:1788581668.682050:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184323712 00000100:00100000:2.0:1788581668.682074:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184323328 00000100:00100000:2.0:1788581668.682076:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184323328 00000100:00100000:2.0:1788581668.682086:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463184323840 00000100:00100000:2.0:1788581668.682088:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463184323840 00000100:00100000:2.0:1788581668.682100:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788581668.682105:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d41c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184323712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581668.682132:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d41c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875463184323712:12345-0@lo:400:kworker.0 Request processed in 27us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581668.682137:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788581668.682147:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788581668.682152:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d41c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184323328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581668.682172:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d41c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875463184323328:12345-0@lo:400:kworker.0 Request processed in 21us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581668.682177:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788581668.682187:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788581668.682192:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff995d41c2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184323840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581668.682227:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff995d41c2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875463184323840:12345-0@lo:400:kworker.0 Request processed in 35us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581668.682234:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788581668.682301:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d41d7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875463184322816:0@lo:400:kworker.0 00000100:00100000:2.0:1788581668.682311:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d41d7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875463184323328:0@lo:400:kworker.0 00010000:00080000:2.0:1788581668.682321:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff995d41d7d180 x1875463184323840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581668.682331:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d41d7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875463184323840:0@lo:400:kworker.0 00000100:00100000:2.0:1788581668.682343:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d41d7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875463184323200:0@lo:400:kworker.0 00000100:00100000:2.0:1788581668.682353:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff995d41d7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875463184323712:0@lo:400:kworker.0 00000100:00080000:3.0:1788581668.682637:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788581668.682641:0:22623:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788581669.062070:0:25711:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788581669.121407:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581670.145412:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14071 lines, 14071 kept, 0 dropped, 0 bad.